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Welcome  to  the  NDIA  Systems  Engineering  Conference 

On  behalf  of  the  National  Defense  Industrial  Association’s  Systems  Engineering  Division,  I  would  like  to 
extend  a  very  warm  welcome  to  the  20th  Annual  Systems  Engineering  Conference.  Yes,  the  20th  Annual 
-  who  knew  when  we  started  this  conference  2  decades  ago  that  we  would  continue  to  have  important 
systems  engineering  issues  to  address?  Well,  perhaps  most  of  you  -  because  after  all,  technology  keeps 
moving,  our  military  capability  continues  to  increase,  the  complexity  of  our  systems  continues  to  grow,  and 
the  threats  we  have  to  address  continue  to  grow  at  an  alarming  rate. 

For  example,  20  years  ago  the  term  “Cybersecurity”  wasn’t  addressed  in  DoD  circles.  Interoperability 
wasn’t  considered.  Systems-of-systems  weren’t  mentioned.  And  today,  these  are  some  of  our  hottest 
issues  that  the  entire  defense-industrial  complex  seeks  to  successfully  address,  not  to  mention  affordability, 
sustainability  and  a  host  of  other  issues  that  continue  to  need  attention. 

This  conference  is  the  primary  one  in  the  US  that  brings  together  the  engineering  arms  of  the  Office  of  the 
Secretary  of  Defense,  the  Services,  many  of  the  Federal  Agencies,  and  the  defense  industrial  complex  to 
address  and  seek  solutions  to  the  issues  we  all  face.  Executives,  managers  and  engineers  from  all  of  the 
major  US  defense  contractors,  as  well  as  the  principal  engineering  executives,  managers  and  engineers 
from  the  Department  of  Defense  and  the  Services  and  Federal  Agencies  are  here,  and  dialog  among  us 
is  critical  to  achieving  a  mutual  understanding  of  the  issues  we  collectively  face  and  desperately  need  to 
solve.  This  conference  provides  an  outstanding  opportunity  to  have  that  dialog  and  exchange  ideas,  so 
please  take  maximum  advantage  of  this  opportunity. 

And  if  there  is  anything  that  the  conference  committee,  whose  names  are  listed  in  the  program,  or  I,  or  the 
outstanding  NDIA  staff  can  do  to  assist  you,  please  let  us  know. 


Bob  Rassa 

Manager,  Engineering  Programs 
Raytheon  Space  &  Airborne  Systems 
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Dear  Attendees,  Speakers  and  Sponsors, 

I  would  like  to  add  my  warm  welcome  to  those  attending  the  annual 
Systems  Engineering  Division  conference.  This  year’s  conference  marks 
the  20th  anniversary  of  this  prestigious  event.  I  congratulate  the  NDIA 
Systems  Engineering  Division  for  their  sustained,  superior  performance  in 
producing  a  highly  consequential  event  and  applaud  the  many  ways  the 
division  supports  the  Defense  Department  and  defense  community. 

This  conference  is  the  premier  event  addressing  the  application  of  systems 
engineering  principles  to  defense  acquisition.  As  such,  it  is  the  main  forum 
to  exchange  information  and  ideas  among  the  Defense  Department,  the 
services,  defense  agencies,  industry  and  academia. 

I  wish  the  best  of  experiences  here  at  the  conference,  and  look  forward  to  many  more  years  of  division 
engagement  with  the  community  to  promote  and  refine  the  systems  engineering  practice. 

Sincerely 


Herbert  J.  Carlisle 
General,  USAF  (Ret) 
President  and  CEO 
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20th  annual  systems  engineering 

CONFERENCE 

OCTOBER  23-26,  2017  |  SPRINGFIELD,  VA 


INTRODUCTION 

Considered  the  major  annual  systems  engineering  event  focusing  on  the  performance  of  DoD  programs  and 
systems,  the  National  Defense  Industrial  Association’s  Annual  Systems  Engineering  Conference  offers  content 
tailored  to  all  levels  of  systems  engineering  (SE)  professionals: 

•  Keynote  Presentation 

•  Systems  Engineering  Executive  Panels 

•  DoD  Executive  Panel:  Service  Systems  Engineering  Leads  discuss  SE  issues 

•  DoD  Executive  Panel:  Interagency  Systems  Engineering  Activity 

•  Industry  Executive  Panel:  Industry  Leaders  discuss  Systems  Engineering  issues 

•  DoD  Executive  Panel:  Service  and  Agency  Program  Managers  discuss  systems  engineering  issues 

•  Technical  Breakout  Sessions  (2+  days) 

Demonstrating  broad  systems  engineering  community  support,  the  conference  is  once  again  this  year  enjoying 
technical  co-sponsorship  by  IEEE  AES,  IEEE  Systems  Council  and  the  International  Council  on  Systems 
Engineering. 

Further  attesting  to  its  value  and  relevance  to  Systems  Engineering  professionals  within  the  defense  industry, 
the  conference  continues  to  receive  the  support  of  the  Office  of  the  Deputy  Assistant  Secretary  of  Defense  for 
Systems  Engineering. 

Major  themes  running  through  the  three  plus  day  agenda  will  include  net-centric  operations,  data/information 
interoperability,  system-of-systems  engineering,  cyber  security  and  all  aspects  of  system  sustainment. 


CONFERENCE  OBJECTIVE 

This  conference  seeks  to  create  an  interactive  forum  for  Program  Managers,  Systems  Engineers,  Chief  Scientists, 
Engineers,  and  Managers  from  the  Requirements,  Design,  Verification,  Support,  Logistics  and  Test  communities 
from  both  government  and  industry.  The  conference  and  the  professional  exchanges  it  will  prompt  will  create 
opportunities  to  shape  future  policy  and  procedures. 
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BACKGROUND 

The  Department  of  Defense  continues  to  seek  ways  to  improve 
the  acquisition  of  military  equipment  and  capability  to  assist  the 
warfighter  in  protecting  the  U.S.  and  its  Allies  around  the  world  in  a 
complex  environment  of  ever-changing  threats  and  conditions. 

The  Weapon  Systems  Acquisition  Reform  Act  (WSARA)  of 
2009  defines  Systems  Engineering  as  a  key  enabler  to  effect 
improvements  in  defense  acquisition  and  program  execution  that 
will  produce  more  effective  and  affordable  military  systems.  Previous 
DoD  Better  Buying  Power  initiatives,  with  their  focus  on  achieving 
dominant  capabilities  through  technical  excellence  and  innovation, 
continued  to  emphasize  the  importance  of  engineering  to  the 
Department.  The  new  administration  seeks  to  increase  military 
spending  which  will  put  additional  onus  on  the  defense  industrial 
complex  to  achieve  acquisition  excellence,  and  systems  engineering 
performance  on  the  part  of  government  and  industry  as  partners  is  a 
key  ingredient  to  success. 

Systems  Engineering  is  the  “umbrella”  engineering  function  that 
drives  successful  program  execution  and  ensures  an  appropriate 
balance  between  requirements,  performance,  cost,  schedule,  and 
overall  effectiveness  and  affordability.  Systems  Engineering  principles 
embody  strong  technical  and  risk/opportunity  management 
aspects  for  the  acquiring  Program  Office  as  well  as  the  prime 
and  subcontractors.  Strong  emphasis  on  systems  engineering 
throughout  a  program,  especially  in  early  development  planning,  is  a 
key  enabler  of  successfully  fielding  complex  defense  systems. 

NDIA’s  Annual  Systems  Engineering  Conference  explores  the  various 
roles  of  systems  engineering  from  all  aspects  and  perspectives— 
pragmatic,  practical  and  academic— and  brings  key  practitioners 
together  to  work  on  effective  solutions  to  achieve  a  successful  and 
affordable  warfighting  force. 


CONFERENCE  CHAIR 

Mr.  Robert  Rassa 
Director,  Engineering 
Programs 

Raytheon  Company 

DIVISION  CHAIR 

Mr.  Frank  Serna 
Principal  Director,  Strategic 
Initiatives 
Draper  Laboratory 

DIVISION  VICE-CHAIR 

Mr.  Joseph  Elm 
Director  of  Engineering 
L-3  Communications 

NDIA  PLANNING  TEAM 

Ms.  Tammy  Kicker,  CMP 
Director,  Meetings  &  Events 

Ms.  Tina  Fletcher 
Meeting  Planner,  Meetings 
&  Events 
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SCHEDULE  AT  A  GLANCE 


MONDAY, 

OCTOBER  23 

8:00  am  - 

12:00  pm 

12:00  pm 

-  5:30  pm 

1 :00  pm  - 

3:00  pm 

3:00  pm  - 

3:30  pm 

3:30  pm  - 

5:30  pm 

TUESDAY, 

OCTOBER  24 

7:00  am  - 

5:00  pm 

7:00  am  - 

8:15  am 

8:15  am  - 

8:30  am 

8:30  am  - 

9:30  am 

9:30  am  - 

10:00  am 

10:00  am 

-  1 1 : 1 5  am 

1 1 : 1 5  am 

-  12:30  pm 

12:30  pm 

-1:30  pm 

1 :30  pm  - 

2:45  pm 

2:45  pm  - 

3:00  pm 

3:00  pm  - 

3:30  pm 

3:30  pm  - 

5:00  pm 

5:00  pm  - 

6:30  pm 

Display  Move  In 

Registration 

Tutorials 

Networking  Break 
Tutorials  continue 


Registration 
Networking  Breakfast 

Opening  Remarks:  Bob  Rassa,  Raytheon;  Frank  Serna,  Draper  Labs 

Plenary  Session  Keynote:  Vice  Admiral  Paul  Grosklags,  USN, 
Commander,  Naval  Air  Systems  Command 

Networking  Break 

Executive  Panel:  DoD  Systems  Engineering 
Executive  Panel:  Interagency  Systems  Engineering 
Networking  Luncheon 

Plenary  Session  Continues:  Industry  Executive  Panel 

Presentation  of  Lt  Gen  Thomas  R.  Ferguson  Systems  Engineering 
Excellence  Awards 

Networking  Break 

Executive  Panel:  Program  Managers 
Networking  Reception 
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WEDNESDAY  OCTOBER  25 


7:00  am  -  5:15  pm 

Registration 

7:00  am  -  8:00  am 

Networking  Breakfast 

8:00  am  -  9:40  am 

Concurrent  Breakout  Focus  Sessions  A 

9:40  am  -  10:15  am 

Networking  Break 

10:15  am  -  1 1 :55  am 

Concurrent  Breakout  Focus  Sessions  B 

1 1 :55  am  -  1 :00  pm 

Networking  Luncheon 

1 :00pm  -  2:40  pm 

Concurrent  Breakout  Focus  Sessions  C 

2:40  pm-  3:15  pm 

3:15  pm  -  5:20  pm 

Networking  Break 

Concurrent  Breakout  Focus  Sessions  D 

THURSDAY  OCTOBER  26 

7:00  am  -  5:15  pm 

Registration 

7:00  am  -  8:00  am 

Networking  Breakfast 

8:00  am  -  9:40  am 

Concurrent  Breakout  Focus  Sessions  A 

9:40  am  -  10:15  am 

Networking  Break 

10:15  am  -  1 1 :55  am 

Concurrent  Breakout  Focus  Sessions  B 

1 1 :55  am  -  1 :00  pm 

Networking  Luncheon 

1:00  pm  -  2:40  pm 

Concurrent  Breakout  Focus  Sessions  C 

2:40  pm-  3:15  pm 

Networking  Break 

3:15  pm  -  5:20  pm 

Concurrent  Breakout  Focus  Sessions  D 
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TRACK  OBJECTIVES 

AGILE  IN  SYSTEMS  ENGINEERING 

Track  Chairs:  John  Norton,  Raytheon  Company 
Linda  Maness,  Northrop  Grumman  Corporation 
Eileen  Wrubel,  Software  Engineering  Institute 

Agile  usage  is  becoming  more  prevalent  within  the  government 
space.  Lessons  learned  and  ideas  for  implementation  can  be  shared 
with  those  who  are  experienced  in  using  Agile  concepts.  This  track 
brings  together  practitioners  with  experience  applying  agile  methods 
in  a  variety  of  disciplines  and  domains,  with  the  goal  of  collaboration 
to  expand  their  effective  use  in  systems  engineering  and  on  defense 
programs 

ARCHITECTURE 

Track  Chairs:  Bob  Scheuer,  The  Boeing 
Ed  Moshinsky,  Lockheed  Martin  Corporation 

Architecture  is  a  key  element  in  systems  engineering.  This  track 
addresses  architecture  frameworks,  strategies,  and  applications  to 
improve  system  design,  test,  operations,  and  support. 

COMPUTATIONAL  RESEARCH  &  ENGINEERING 
ACQUISITION  TOOLS  AND  ENVIRONMENTS  (CREATE) 

Track  Chair:  Douglass  Post,  DoD  High  Performance  Computing 
Modernization  Program  (HPCMP) 

The  DoD  HPCMP  CREATE  Program  is  a  Tri-Service  Program 
launched  in  2006  by  OSD  and  the  HPCMP  to  develop  and  deploy 
eleven  physics-based  high  performance  computing  software 
applications  specifically  to  enable  the  DoD  acquisition  engineering 
community  to  design  and  analyze  military  ships,  aircraft,  ground 
vehicles,  and  radio  frequency  antennas.  These  tools  enable 
engineers  to  generate  an  arbitrarily  large  number  of  design  options 
(virtual  prototypes  expressed  as  digital  product  models)  for  design- 
space  exploration,  rapidly  assess  the  feasibility  and  performance 
characteristics  of  each  design  option,  and  accurately  predict  the 
performance  of  each  weapon  platform  with  high-fidelity  tools. 
With  these  tools,  DoD  engineers  can  identify  design  defects  and 
performance  shortfalls  and  fix  them  before  metal  has  been  cut, 
thus  reducing  costly  rework  and  improving  system  performance. 
This  reduces  the  cost,  schedule,  and  risk  of  acquisition  programs. 
The  tools  and  computer  time  are  available  to  DoD  engineers 
(government  and  industry).  The  tools  are  being  used  by  more  than 
180  DoD  engineering  organizations  (government  40%,  industry 
50%,  and  other  10%— including  academia)  with  over  1,400  users. 

DEVELOPMENTAL  TEST  &  EVALUATION  (DT&E) 

Track  Chairs:  Joe  Manas,  Raytheon  Company 

Developmental  Test  and  Evaluation  is  a  key  aspect  of  successful 
systems  engineering.  This  track  addresses  the  entire  continuum  of 
test  and  evaluation  from  early  planning  to  operational  testing. 

DIGITAL  ENGINEERING/MODEL-BASED  SYSTEMS 
ENGINEERING 

Track  Chair:  Philomena  Zimmerman,  DASD/SE 

Digital  Engineering  is  an  emerging  set  of  practices  for  Systems 
Engineering  and  other  engineering  disciplines  which  has,  at  its 
core,  the  use  of  models  (data,  algorithms  and/or  processes)  as  a 
technical  means  of  communication.  When  used  properly,  models 
can  provide  a  cohesion  across  engineering  activities,  and  cohesion 


with  acquisition  activities.  When  coupled  with  computational 
capabilities,  resultant  data  from  simulations  can  be  used  in 
decision-making  at  all  echelons,  and  an  increased  level  of  insight 
and  risk  reduction  in  the  end  item  can  be  achieved. 

ENGINEERED  RESILIENT  SYSTEMS  (ERS) 

Track  Chairs:  Lois  Hoi  Ian,  Potomac  Institute 

Engineered  Resilient  Systems  (ERS)  is  a  Department  of  Defense 
priority  initiative  that  seeks  to  transform  engineering  environments 
so  that  warfighting  systems  are  more  resilient  and  affordable  across 
the  acquisition  lifecycle.  The  track  will  present  new  results  across 
the  ERS  initiative  including  anchor  technologies  and  computational 
representation. 

EDUCATION  &  TRAINING 

Track  Chair:  Don  Gelosh,  Worcester  Polytechnic  Institute 

The  Education  and  Training  track  for  2017  is  an  excellent  collection 
of  thirteen  presentations  from  government,  industry,  and  academia. 
The  presentations  describe  a  wide  range  of  systems  engineering 
workforce  development  activities  from  competency  frameworks, 
cybersecurity  skills,  MBE  and  MBSE  best  practices,  System  of 
Systems  guide  and  capstone  marketplace  to  development  of 
technical  leaders. 

ENTERPRISE  HEALTH  MANAGEMENT/PROGNOSTICS/ 
DIAGNOSTICS/RELIABILTY 

Track  Chairs:  Chris  Resig,  The  Boeing  Company 

The  health  of  the  system  asawhole-theenterprise-isacritical  function 
of  systems  engineering.  This  session  will  touch  on  some  issues  relating 
to  the  system  health,  including  prognostics,  diagnostics  and  reliability. 

ENVIRONMENT,  SAFETY,  AND  OCCUPATIONAL  HEALTH 
(ESOH) 

Track  Chairs:  Sherman  Forbes,  USAF 

Dave  Schulte,  SAIC 

Lucy  Rodriguez,  Booz  Allen  Hamilton 

The  ESOH  track  provides  a  cross  section  of  topics  that  reflect  the 
many  different  Systems  Engineering  design  considerations  included 
under  the  DoDI  5000.02  acronym  ESOH,  as  defined  in  MIL-STD- 
882E,  the  DoD  Standard  Practice  for  System  Safety.  This  year,  Mr. 
James  Thompson,  Director,  Major  Program  Support  (MPS),  within 
the  Office  of  the  Deputy  Assistant  Secretary  of  Defense  for  Systems 
Engineering  will  be  the  ESOH  track’s  keynote  speaker.  Mr.  Thompson 
will  share  his  perspectives  on  Risk,  Issue,  and  Opportunity  (RIO) 
Management  and  Independent  Technical  Risk  Assessments  (ITRAs). 
Mr.  David  Asiello,  the  Acquisition,  Sustainability  &  Technology 
Programs  lead  in  the  Office  of  the  Assistant  Secretary  of  Defense 
for  Energy,  Installations,  and  Environment  will  follow  Mr.  Thompson’s 
presentation  with  a  presentation  focusing  on  how  ESOH  Risk 
Management  is  an  integral  part  of  the  RIO  Management  Process 
and  offering  suggestions  for  improving  the  rigor,  accountability, 
and  visibility  of  ESOH  risk  management.  There  will  be  an  extended 
question  and  answer  period  following  Mr.  Thompson’s  and  Mr. 
Asiello’s  presentations  to  allow  the  audience  to  further  explore  the 
Acquisition  and  Sustainment  Risk  Management.  The  remainder  of 
the  ESOH  track  presentations  will  address  specific  acquisition  ESOH 
issues,  to  include  using  Digital  Engineering  to  manage  ESOH  risks 
and  requirements,  how  to  manage  ESOH  in  Rapid  Acquisitions, 
software  system  safety,  hazardous  materials  regulations  and 
management  impacts  on  programs,  environmental  liabilities, 
environmental  sustainability,  and  lessons  learned  about  program 
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office  successes  and  failures  in  implementing  the  DoDI  5000.02 
acquisition  ESOH  policy. 

HUMAN  SYSTEMS  INTEGRATION  (HSI) 

Track  Chair:  Matthew  Risser,  Pacific  Science 
Patrick  Fly,  The  Boeing  Company 

The  HSI  sessions  include  technical  papers  aligned  with  DoD  HSI  policy, 
standards  and  guidance.  The  goal  is  to  address  HSI  implications  in 
the  design  of  complex  systems  in  support  of  systems  engineering 
and  include  HSI  methods,  metrics,  and  best  practices,  process 
improvements,  applications  and  approaches  to  program  integration. 

INTEROPERABILITY/NET  -  CENTRIC  OPERATIONS 

Track  Chairs:  Jack  Zavin,  OUSD/ATL 
John  Daly,  Booz-Allen-Hamilton 

Interoperability  is  ability  to  operate  in  synergy  in  the  execution  of 
assigned  tasks  both  within  the  DoD  and  its  external  mission  partners. 
Net  Centric  Operations  supports  interoperability  by  providing  the 
POPIM  solution  sets  that  allows  the  DoD  and  its  mission  partners 
to  share  information/data/knowledge  when  needed,  where  needed, 
and  in  a  form  they  can  understand  and  act  on  with  confidence, 
while  protecting  it  from  those  who  should  not  have  it.  Net  Centric 
Operations/Interoperability  includes  technologies  such  as  Service 
Oriented  Architecture,  Data  Center,  Cloud  Computing,  information 
transport  [e.g.  internet,  web,  radios,  data  links],  as  well  as  both 
hardware  and  software  [aka  Information  and  Communicative 
Technology]  together  with  people,  operating  alone  or  in  organizations, 
as  part  of  the  System  of  Systems  Systems  Engineering. 

MISSION  ENGINEERING 

Track  Chair:  Judith  Dahmann,  MITRE 

Mission  engineering  (ME)  is  the  deliberate  planning,  analyzing, 
organizing,  and  integrating  of  current  and  emerging  operational 
and  system  capabilities  to  achieve  desired  warfighting  mission 
effects.  This  track  focuses  on  current  directions  in  Defense  ME  and 
approaches  to  applying  SoS  and  SE  approach  to  ME. 

MODELING  AND  SIMULATION  (M&S) 

Track  Chairs:  David  Allsop,  The  Boeing  Company 
Chris  Schreiber,  Lockheed  Martin  Corpration 

The  M&S  Track  highlights  the  use  of  models  and  simulations  in 
the  systems  engineering  process.  Included  are  presentations  on 
integrated  environments,  tools  &  technologies,  and  M&S  applications 
in  several  SE  process  phases.  Topics  focused  specifically  on  Digital 
Engineering/Model-based  Systems  Engineering  are  contained  in  a 
separate  track  on  this  topic. 

PROGRAM  MANAGEMENT 

Track  Chairs:  Ken  Nidiffer,  Software  Engineering  Institute 

Program  Managers  and  chief  Systems  Engineers  should  be  the 
“joined-at-the-hip”  leads  on  all  programs  that  wish  to  be  successful. 
This  session  will  address  some  of  the  issues  that  our  program 
managers  face  in  the  execution  of  programs. 


SOFTWARE  ENGINEERING 

Track  Chairs:  Ken  Nidiffer,  Software  Engineering  Institute 

Software  is  often  overlooked  when  talking  systems  engineering  yet 
software  is  a  key  element  of  most  designs  today  and  must  always  be 
part  of  the  systems  engineer’s  portfolio  of  responsibility.  This  session 
will  highlight  a  few  significant  software  development  issues. 

SYSTEMS  ENGINEERING  EFFECTIVENESS 

Track  Chairs:  Tim  White,  Raytheon  Company 
Joe  Elm,  L3  Technologies 

Systems  Engineering  Effectiveness  is  obvious  to  some  and  quite 
esoteric  to  others.  The  goal  though,  improving  the  value  obtained 
for  each  SE  dollar  spent,  is  shared  by  each  who  joins  the  discussion. 
Please  attend  the  SE  Effectiveness  track  to  learn  how  your  peers  are 
implementing  practical  measures  to  better  quantify  the  benefits  of 
Systems  Engineering  and  its  value  to  Product  Users  and  Developers 
alike.  Early  and  effective  Systems  Engineering  has  been  shown  to 
return  excellent  value  to  all  project  stakeholders.  This  Track  will 
highlight  the  latest  DoD  policy  and  guidance,  define  new  approaches, 
and  provide  some  practical  experiences  to  assist  the  DoD  and 
defense  industry  SE  community  in  achieving  a  quantifiable  and 
persistent  improvement  in  program  outcomes  through  appropriate 
application  of  systems  engineering  principles  and  best  practices. 


SYSTEMS  OF  SYSTEMS  (SOS) 

Track  Chairs:  Judith  Dahmann,  MITRE 
Rick  Poel,  The  Boeing  Company 
Jennie  Horn,  Raytheon  Company 

The  System  of  Systems  track  will  feature  papers  highlighting 
development  SoS  engineering  approaches,  particular  SoS  SE 
application  areas,  and  SoS  tools  and  modeling,  including  SoS  SE 
applied  to  defense  missions  in  mission  engineering.  See  directly 
related  track  in  Mission  Engineering,  above. 

SYSTEM  SECURITY  ENGINEERING  (SSE) 

Track  Chairs:  Holly  Dunlap,  Raytheon  Company 
Melinda  Reed,  DASD/SE 

System  Security  Engineering  has  become  one  of  the  most  important 
aspects  in  the  design  of  DoD  systems.  This  track  will  focus  on  system 
security  engineering  and  a  holistic  approach  to  program  protection. 
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SYSTEMS  ENGINEERING  CONFERENCE 


Monday,  October  23 


8:00am  -  12:00pm 
12:00pm  -  5:30pm 
1 :00  pm  -  5:30  pm 


Display  Move  In 
Registration  Open 
Tutorials 


3:00pm  -  3:30pm  Networking  Break 


3:30pm  -  4:00pm  4:00pm  -  4:30pm  4:30pm  -  5:00pm  5:00pm  -  5:30pm 

Track  4 

Gibson 

Tutorial: 
Modeling  and 
Simulation 
(M&S)  Cont’d 

1D4 

19696 

Half-Day  Tutorial:  Modeling  and  Simulation  in  the  Systems  Engineering  Process 
►  Dr.  Jim  Coolahan,  Coolahan  Consultants,  LLC 

Track  5 

Seller 

Tutorial: 
Applying  MIL- 
STD  Cont’d 

1D5 

19702 

Tutorial:  Applying  Focused  MIL-STD-882E  Software  Safety  Level  of  Rigor 
►  Mr.  Stuart  Whitford,  Booz  Allen  Hamilton 

Track  6 

Korman 

Tutorial: 
Communication 
and  Analysis 
Cont’d 

1D6 

19713 

Effective  Communication  and  Analysis  in  the  Age  of  MBSE 
►  Mr.  Ronald  Kratzke,  Vitech  Corporation 

5:30pm  Adjourn 
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SYSTEMS  ENGINEERING  CONFERENCE 


Tuesday,  October  24 


7:00am  -  5:00pm 
7:00am  -  8:15am 
8:15am  -  8:30am 


8:30am  -  9:30am 

9:30am  -  10:00am 
10:00am  -  11:15am 


Registration  Open 
Networking  Breakfast 
Opening  Remarks 

Mr.  Robert  Rassa,  Director,  Engineering  Programs,  Raytheon  Company;  NDIA  Systems  Engineering  Conference 
Chair 

Mr.  Frank  Serna,  Principal  Director,  Strategic  Initiatives,  Draper  Laboratory;  Chair,  NDIA  Systems  Engineering  Division 

Keynote  Presentation 

VADM  Paul  Grosklags,  NAVAIR,  Commander,  Naval  Air  Systems  Command 

Networking  Break 

DoD  Executive  Panel:  DoD  Systems  Engineering 

Moderator:  Mrs  Kristen  Baldwin,  Deputy  Assistant  Secretary  of  Defense,  Systems  Engineering  (Acting) 

Panelists: 

•  Col  Laird  Abbott,  USAF,  Chief,  Engineering  and  Force  Management  Division,  Deputy  Assistant  Secretary  for 
Science,  Technology,  and  Engineering,  SAF-AQR 

•  Mr.  William  Bray,  USN,  DASN  RDT&E  and  Chief  Systems  Engineer 

•  Mr.  Douglas  Wiltsie,  USA,  Executive  Director,  SoSE&l,  ASA  ALT  (invited) 


1 1  :15am  -  12:30pm 


12:30pm  -  1  :30pm 
1  :30pm  -  2:45pm 


2:45pm  -  3:00pm 
3:00pm  -  3:30pm 
3:30pm  -  5:00pm 


Executive  Panel:  Interagency  Systems  Engineering 

Moderator:  Ms.  Kristen  Baldwin,  Deputy  Assistant  Secretary  of  Defense,  Systems  Engineering  (Acting) 

Panelists: 

•  Mr.  Albert  “Benjie”  Spencer,  National  Oceanic  and  Atmospheric  Administration 

•  Mr.  Jon  Holladay,  Technical  Fellow  for  Systems  Engineering,  National  Aeronautics  and  Space  Admnistration 

•  Mr.  Kent  Jones,  Assistant  Deputy  Administrator  for  Systems  Engineering  and  Integration,  Defense  Programs, 
DOE  National  Nuclear  Security  Administration 

•  Mr.  Joseph  Post,  Deputy  Director,  NAS  Systems  Engineering  &  Integration  Federal  Aviation  Administration 

•  Mr.  James  Tuttle,  Deputy  Director,  CDS  and  Chief  Systems  Engineering,  Department  of  Homeland  Security 

Networking  Luncheon 

Industry  Executive  Panel:  Model-Based  Systems  Engineering:  How  is  it  Helping? 

Mr.  Frank  Serna,  Principal  Director,  Strategic  Initiatives,  Draper  Laboratory;  Chair,  NDIA  Systems  Engineering  Division 

Panelists: 

•  Ms.  Christi  Gau  Pagnanelli,  Director,  BDS  Systems  Engineering  and  Engineering  Multi-Skilled  Leadership, 

Boeing  Defense,  Space  &  Security 

•  Mr.  Randall  Lum,  Corporate  Director,  Engineering,  Northrop  Grumman  Corporation 

•  Mr.  Tim  Walden,  Chief  Engineer  and  Fellow,  Lockheed  Martin  Corporate  Engineering  and  Production  Operations 

•  Mr.  Scott  Welles,  Vice  President,  Booz  Allen  Hamilton 

Presentation  of  Lt  Gen  Thomas  R.  Ferguson  Systems  Engineering  Excellence  Awards 
Networking  Break 

Executive  Panel:  Program  Managers 
Moderator:  Col.  David  Mclllece,  USAF 

Panelists: 

•  Col  Edward  Hospodar,  USAF,  GPS  User  Equipment  Senior  Materiel  Leader 

•  COL  Mike  Milner,  USA,  Armored  Multi-Purpose  Vehicle  (AMPV)  Program  Manager 

•  Col  Amanda  Myers,  USAF,  Deputy  Director,  Global  Reach  Programs,  Former  C-17  System  Program  Manager 

•  CAPT  Seiko  Okano,  USN,  PEO  Integrated  Wardare  Systems  (IWS)  2.0  Program  Manager 


5:00pm  -  6:30pm  Networking  Reception 
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SYSTEMS  ENGINEERING  CONFERENCE 


Wednesday,  October  25 

7:00am-5  :15pm  Registration 


7:00am-8:00am  Networking  Breakfast 


8:00am  -  8:25am 

8:25am  -  8:50am 

8:50am  -  9:15am 

9:15am  -  9:40am 

Track  1 

Singleton 

Human  Systems 
Integration 

3A1 

19516 

Enhancing  Future  Soldier 
Systems  through  the  use 
of  the  Systems  Modeling 
Language  to  Incorporate 
Human  Aspects  into 
the  Soldier  as  a  System 
Definition 

►  Mr.  Sean  Pham,  U.S. 

Army ARDEC 

19641 

HSI  Best  Practice  Standard 

►  Dr.  Patrick  Fly, 

The  Boeing  Company 

19739 

The  Human  Systems 
Integration  Partnership:: 
Delivering  the  HSI  Capability 
to  the  Air  Force  Systems 
Engineering  Process 

►  Mr.  Derek  Johnston, 

United  States  Air  Force 

19919 

Adaptive  Automation  for 

UAV  Pilot  Vehicle  Interfaces 

►  Mr.  Jeff  O’Hara,  Georgia 
Tech  Research  Institute 

Track  2 

DC 

LU 

_l 

_l 

Net  Centric 
Operations  & 
Interoperability 

3A2 

19752 

Kick  Off/Context  for  NCO/I 
Track 

►  Mr.  Jack  Zavin, 
DoD/OUSD(AT&L) 

19815 

ISO/I  EC/I  EE E8  15288 

System  Interoperability 
Considerations 

►  Mr.  John  Daly,  Booz  Allen 
Hamilton 

19759 

JITC  Executes  DoD  Mobility 
Field  Assessments 

►  Mr.  Khoa  Hoang,  Joint 
Interoperability  Test 
Command 

19764 

Interface  Management  for 
Interoperability- from  Theory 
to  Modeling 

►  Mr.  Matthew  Hause,  PTC 

Track  3 

Von  Sternberg 

Engineering  & 
Model-based 
Systems 
Engineering 

3A3 

19819 

DoD  Digital  Engineering 
Strategy 

►  Ms.  Philomena 

Zimmerman,  Department  of 
Defense 

19879 

Model  Centric  Engineering 
Enabling  a  New  Operational 
Paradigm  for  Acquisition 

►  Dr.  Mark  Blackburn, 
Stevens  Institute  of 
Technology 

19853 

Joint  NDIA  SSE  &  SwA 
Committee  and  Joint 
Federated  Assurance 

Center,  Government  SwA 

Gap  Analysis  Workshop 
Summary 

►  Ms.  Holly  Dunlap, 

Raytheon  Company 

19855 

MBSE  and  Systems 
Engineering  Transformation 

►  Mr.  Troy  Peterson, 

INCOSE 

Track  4 

Gibson 

Modeling  & 
Simulation 

3A4 

19691 

An  Autonomous  Sensor 
Tasking  System 

►  Ms.  Quintina  Jones, 
Raytheon  Missile  Systems 

19711 

Best  Practices  for  the 
Architecture,  Design,  and 
Modernization  of  Defense 
Models  and  Simulations 

►  Mr.  Michael  Heaphy, 
AT&L/DMSCO 

19725 

W&A  of  Models  and 
Simulations:  The  Power  of 
Independent  Cumulative 
Analyses 

►  Ms.  Natalie  Plotkin, 
Raytheon  Company 

19916 

Formalized  Execution  of 

Model  Integrated  Descriptive 
Architecture  Languages 

►  Mr.  Gregory  Haun, 
Analytical  Graphics,  Inc. 

Track  5 

Seller 

Agile 

3A5 

19877 

Research  Gone  “Agile”  A 

Case  Study  on  Using  an 
Enterprise  Transformation 
Process  to  Enable  Agile 
Methods  in  a  Research 
Program 

►  Dr.  Rosa  Heckle,  The 
MITRE  Corporation 

19726 

Issues  anOpportunities 
in  Accelerated  Software 
Development  for  Next 
Generation  DoD  Applications 

►  Dr.  Craig  Arndt, 

Defense  Acquisition 

University 

19755 

A  System  Dynamics 

Model  of  the  Scaled  Agile 
Framework  (SAFe)  to 

Quantify  the  Effects  of 
Management  Decisions  on 
Capability  Development  and 
Acquisition  Outcomes 

►  Mr.  Sean  Ricks,  The 

MITRE  Corporation 

19777 

“Elicitation  of  Robust  and 
Quality  Agile  User  Stories 
Using  QFD” 

►  Ms.  Sabrina  Ussery, 

The  George  Washington 
University 

Track  6 

Korman 

Software 

3A6 

19745 

Software  Complexity 

Modeling 

►  Mr.  Thuc  Tran, 

Capital  One 

19749 

Harnessing  the  Beast:  Using 
Model  Based  Systems 
Engineering  (MBSE)  to 
Manage  Complex  Research 
Software  Environments 

►  Ms.  Jennifer  Turgeon, 
Sandia  National 

Laboratories 

19758 

Software  Systems  Maturity 
Analysis 

►  Mr.  Christopher 

Dieckmann,  Idaho  National 
Laboratory 

19816 

Free  and  Open  Source 

Tools  to  Assess  Software 
Reliability  and  Security 

►  Mr.  Lance  Fiondella, 
University  of  Massachusetts 
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SYSTEMS  ENGINEERING  CONFERENCE 


Wednesday,  October  25  -  Continued 


9:40am-10:15am  Networking  Break 


10:15am  -  10:40am 

10:40am  -  11:05am 

11:05am  -  11:30am 

11:30am  -  11:55am 

Human  Systems 
Integration 

19784 

A  Wearable  Vision+lnertial 

19740 

Fisher  vs.  Taguchi 

19854 

NDIA  Welcome  and  Review 

19881 

DoD  Cyber  Resilient  Weapon 

Track  1 

Singleton 

Systems 

Security 

Engineering 

3B1 

Navigation  System  for 
Assessing  Volumetric 
Utilization  and  Task 

Geometry  Efficiency 

►  Mr.  Kevin  Duda, 

Draper  Laboratory 

Experimental  Design 

Methods  in  Human  Factors 

►  Ms.  Sarah  Ewing, 

Idaho  National  Laboratory 

of  Accomplishments 

►  Ms.  Holly  Dunlap, 

Raytheon  Company 

Systems 

►  Ms.  Melinda  Reed, 
Department  of  Defense 

CM 

o 

DC 

LU 

l 

Net  Centric 
Operations  & 
Interoperability 

19923 

Joint  and  Mission  Partner 
Interoperability 

19499 

Real  Life  Cloud  Acquisition 
and  Adoption  Across 

19849 

Mission  Integration 
Management,  NDAA  201 7 

19838 

Systems  of  Systems 
Engineering  Technical 

< 

£ 

Mission 

Engineering 

3B2 

►  Mr.  Mike  Richards, 

Joint  Staff  J6 

Myeriues  anu  wiouu 

Providers 

►  Mr.  Mun-Wai  Hon,  Noblis 

oeotion  ooo 

►  Mr.  Robert  Gold, 
Department  of  Defense 

Approduneo  db  Mppneu  10 
Mission  Engineering 

►  Dr.  Judith  Dahmann, 

MITRE 

00 

o 

< 

£ 

Von  Sternberg 

Digital 

Engineering  & 
Model-based 
Systems 
Engineering 

3B3 

19793 

Model-Centric  Decision 
Making:  Insights  from  an 
Expert  Interview  Study 

►  Dr.  Donna  Rhodes, 
Massachusetts  Institute  of 
Technology 

19890 

Using  MBSE  to 

Communicate  and  Gain 
Acceptance  of  your  Analysis 
►  Mr.  Frank  Salvatore, 

Engility 

19795 

New  Innovations  in  Digital 
Systems  Engineering 

►  Dr.  Edward  Kraft, 

University  of  Tennessee 
Space  Institute 

19920 

Key  MBSE  Enablers  with 
Examples 

►  Mr.  Nicholas  Driscoll,  III, 
Raytheon  Company 

Track  4 

Gibson 

CREATE 
Computational 
Research  & 
Engineering 
Acquisition 
Tools  and 
Environments 

3B4 

20010 

Digital  Engineering  (DE)  and 
Computational  Research 
and  Engineering  Acquisition 
Tools  and  Environments 
(CREATE) 

►  Ms.  Philomena 

Zimmerman, 

Department  of  Defense 

19721 

CREATE:  Accelerating 

Defense  Innovation  with 
Computational  Prototypes 
and  High  Performance 
Computers 

►  Dr.  Douglass  Post, 

DoD  HPCMP 

19730 

Physics-Based  Simulation 
in  Support  of  Acquisition 
program  and  Fleet 

Operations 

►  Mr.  Steven  Donaldson, 
Naval  Air  Systems 

Command 

19728 

Capstone:  A  Patform  for 
Geometry,  Meshing  and 
Attribution  Modeling  for 
Physics-based  Analysis  and 
Design 

►  Dr.  Saikat  Dey, 

US  NRL  Code  7131 

Agile 

19902 

Software  Development 
Challenges  in  AFMC  (Agile 
Software  Development  and 
Data  Rights) 

►  Mr.  Andrew  Jeselson,  Air 
Force  Materiel  Command 

19701 

Leveraging  Cybersecurity 
Tools  for  Software  Safety: 
Focusing  (Some)  Static 
Analysis  on  Safety-Critical 
Software 

►  Mr.  Stuart  Whitford, 

Booz  Allen  Hamilton 

20028 

Joint  Software  System 

Safety  Implementation  Guide 

►  Mr.  Bob  Smith, 

Booz  Allen  Hamilton 

Track  5 

Seller 

Environment 
Safety  & 
Occupational 
Health 

3B5 

Systems 

Engineering 

Effectiveness 

19850 

Engineering  Autonomy 

19882 

The  Drive  for  Innovation  in 

19814 

DoD  Systems  Engineering 

19835 

Helix:  Understanding 

CO 

z 

►  Mr.  Robert  Gold, 

Systems  Engineering 

Policy,  Guidance  and 

Systems  Engineering 

a 

£ 

< 

DC 

O 

3B6 

Department  of  Defense 

►  Mr.  Scott  Lusero, 
Department  of  Defense 

Standardization 

►  Ms.  Aileen  Sedmak, 
Department  of  Defense 

Effectiveness  through 

Modeling 

►  Ms.  Nicole  Hutchison, 
Stevens  Institute  of 
Technology 

1 1  :55am  -  1  :00pm  Networking  Luncheon 
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SYSTEMS  ENGINEERING  CONFERENCE 


Wednesday,  October  25  -  Continued 


1:00pm  -  1:25pm 

1:25pm  -  1:50pm 

1:50pm  -  2:15pm 

2:15pm  -  2:40pm 

Track  1 

Singleton 

System  Security 
Engineering 

3C1 

19852 

NDIA  Cyber  Resilient  & 

Secure  Systems  Summit 
Summary 

►  Ms.  Holly  Dunlap, 

Raytheon  Company 

19839 

Unified  Architecture 
Framework  (UAF)  Profile 
for  Risk  Assessment 
Methodology 

►  Ms.  Tamara  Hambrick, 
Northrop  Grumman 
Corporation 

19913 

Considerations  to  Address 
Dependably  Secure 

System  Function  in  System 
Capability,  Requirements, 
and  Performance  Artifacts 

►  Mr.  Michael  McEvilley, 

The  MITRE  Corporation 

19866 

AF  Cyber  Campaign  Plan  - 
Weapon  Systems  Focus 

►  Mr.  Daniel  Holtzman,  U.S. 
Air  Force 

CM 

o 

< 

£ 

Miller 

Mission 

Engineering 

System  of 
Systems 

3C2 

19706 

Model  Based  Systems  of 
Systems  Engineering 

►  Mr.  Francis  McCafferty, 
Vitech  Corporation 

19868 

Mission  Threads:  Linking 
Mission  Engineering  and 
Systems  Engineering 

►  Dr.  Greg  Butler, 

Engility  Corp 

19718 

Developing  Standards  for 
Systems  of  Systems  (SoS) 
Engineering 

►  Dr.  Judith  Dahmann, 

The  MITRE  Corporation 

19804 

Scaling  Model-Based 

System  Engineering 

Practices  for  System  of 
Systems  Applications: 
Software  Tools 

►  Ms.  Janna  Kamenetsky, 
The  MITRE  Corporation 

Track  3 

Von  Sternberg 

Digital 

Engineering  & 
Model-based 
Systems 
Engineering 

3C3 

19545 

Pulling  the  Digital  Thread 
with  Model  Based 

Engineering 

►  Mr.  Christopher  Finlay, 
Raytheon  Company 

19906 

Modeling  the  Digital  System 
Model  Data  Taxonomy 

►  Ms.  Philomena 
Zimmerman, 

Department  of  Defense 

19746 

Developing  and  Distributing 
a  CubeSat  Model-Based 
Systems  Engineering 
(MBSE)  Reference  Model  - 
Interim  Status  #2 

►  Dr.  David  Kaslow,  S.E.L.F 

19872 

Enabling  Design  of  Agile 
Security  with  MBSE 

►  Mr.  Barry  Papke, 

No  Magic 

Track  4 

Gibson 

CREATE: 
Computational 
Research  & 
Engineering 
Acquisition 
Tools  and 
Environments 
Engineering 

3C4 

19779 

High-Fidelity 

Electromagnetic  Modeling 
with  CREATE-RF  Tools 

►  Dr.  Daniel  Dault,  Air  Force 
Research  Lab 

19809 

Physics  Based  Modeling  & 
Simulation  For  Shock  and 
Vulnerability  Assessments 
-  Navy  Enhanced  Sierra 
Mechanics 

►  Mr.  Jonathan  Stergiou, 
Naval  Surface  Warfare 

Center,  Carderock  Division 

19823 

The  Role  of  CREATE-AV 
in  Realization  of  the  Digital 
Thread  “Authoritative  Truth 
Source” 

►  Dr.  Edward  Kraft, 

University  of  Tennessee 

Space  Institute 

19753 

A  Networked  Frigate 

Concept  Design  Space 
Exploration  Using  the  Rapid 
Ship  Design  Environment 

►  Dr.  Douglas  Rigterink, 

Navel  Surface  Warfare 

Center,  Carderock  Division 

Track  5 

Seller 

Environment 
Safety  & 
Occupational 
Health 

3C5 

19912 

DASD  (SE)  Risk,  Issue, 
and  Opportunity  (RIO) 
Management  and 

Independent  Technical  Risk 
Assessments  (ITRAs) 

►  Mr.  James  Thompson, 
Department  of  Defense 

19697 

ESOH  Risk  Management 

►  Mr.  David  Asiello, 
OASD(EI&E) 

19908 

DoD  Acquisition  ESOH  IPT  Q&A  Panel 

►  Mr.  David  Asiello, 

OASD(EI&E) 

Track  6 

Korman 

Systems 

Engineering 

Effectiveness 

3C6 

19790 

Systems  Engineering 
Research  Needs  and 
Workforce  Development 

Study 

►  Dr.  Dinesh  Verma, 

Systems  Engineering 
Research  Center  (SERC) 

19744 

Technical  Performance  Risk 
Management  for  Large 

Scale  Programs 

►  Mr.  Brian  Davenport, 
Raytheon  Company 

19742 

The  Design  of  a  Cone 
Penetrometer  System 

►  Dr.  Doris  Turnage, 

U.  S.  Army  Engineer 
Research  &  Development 
Center 

19781 

Additive  Manufacturing  - 
Challenges  for  the  Systems 
Engineer  and  Program 
Manager 

►  Mr.  William  Decker, 

Defense  Acquisition 

University 
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Wednesday,  October  25  -  Continued 


2:40pm  -  3:15pm  Networking  Break 


3:15pm  -  3:40pm 

3:40pm  -  4:05pm 

4:05pm  -  4:30pm 

Track  1 

Singleton 

System 

Security 

Engineering 

3D1 

19861 

Cyber  Resilient  and  Secure  Weapon 
Systems  Acquisition/Proposal 

Discussion  &  Summary 

►  Ms.  Holly  Dunlap,  Raytheon 

Company 

19771 

When  the  Right  Answer  is  Not  What 
NAVSEA  Normally  Does 

►  Mr.  Peter  Chu,  NAVSEA  05 

19870 

Can’t  We  Just  Get  Along:  Engineering 
Trade  Decisions  VS  RMF  at  the  System 
Level 

►  Mr.  Don  Davidson,  DoD  CIO 

Track  2 

DC 

LU 

_l 

_l 

System  of 
Systems 

3D2 

19802 

Scaling  Model-Based  System 

Engineering  Practices  for  System  of 
Systems  Applications:  Analytic  Methods 

►  Dr.  Aleksandra  Markina-Khusid, 

The  MITRE  Corporation 

19757 

Defense  System  of  Systems  Gap 

Analysis 

►  Mr.  Christopher  Dieckmann, 

Idaho  National  Laboratory 

19878 

Enterprise  Implications  of  Family  of 
Systems  (FoS)  Acquisition 

►  Dr.  Garrett  Thurston, 

Dassault  Systemes 

Track  3 

Von  Sternberg 

Digital 

Engineering  & 
Model-based 
Systems 
Engineering 

3D3 

19775 

Digital  System  Model  Ice 

►  Dr.  David  Hench, 

Eagle  Ray  R&D 

19871 

Enabling  Repeatable  SE  Cost 

Estimation  with  COSYSMO  and  MBSE 

►  Mr.  Barry  Papke,  No  Magic 

19888 

MBSE  to  Address  Logical  Text-Based 
Requirements  Issues 

►  Dr.  Saulius  Pavalkis, 

No  Magic 

Track  4 

Gibson 

CREATE: 
Computational 
Research  & 
Engineering 
Acquisition 
Tools  and 
Environments 
Engineering 

3D4 

19693 

Program  Management  in  CREATE 
for  the  Development  of  Large-scale 
Physics-based  Software  Development 
Projects  for  Engineering  Design  and 
Analysis 

►  Dr.  Richard  Kendall, 

DoD  HPCMP 

19704 

Computational  Research  and 
Engineering  Acquisition  Tools  and 
Environments  -  Ground  Vehicles 
(CREATE-GV) 

►  Dr.  Christopher  Goodin,  U.S.  Army 
ERDC 

19715 

Physics-based,  Multidisciplinary 

Analysis  of  Fixed-Wing  Aircraft  with 
HPCMP  CREATE(TM)-AV/Kestrel 

►  Dr.  David  McDaniel, 

DoD  HPCMP/CREATE 

Track  5 

Seller 

Environment 
Safety  & 
Occupational 
Health 

3D5 

19770 

Assessing  the  impacts  of  Amended  Toxic  Substances  Control  Act  to  the  DoD  Mission  and  the  Defense  Industrial  Base  Panel 

►  Ms.  Amy  Borman,  U.S.  Army 

►  COL  Joseph  Constantino  (SAF/IEE) 

►  Mr.  Shane  Esola,  DCMA 

►  Mr.  Jim  Rudroff,  (ODASN(E)) 

►  Dr.  Patricia  Underwood,  OASD(EI&E) 

Track  6 

Korman 

Systems 

Engineering 

Effectiveness 

3D6 

19738 

Improving  Effectiveness  with  respect 
to  Time-To-Market  and  the  Impacts  of 
Late-stage  Design  Changes  in  Rapid 
Development  Life  Cycles 

►  Mr.  Parth  Shah, 

George  Washington  University 

19716 

Integrity  System  Security  Engineering 
into  System  Engineering 

►  Mr.  Ken  Barker,  USAF 

19824 

Implementation  of  the  R&M  Engineering 
Body  of  Knowledge 

►  Mr.  Andrew  Monje, 

Department  of  Defense 
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SYSTEMS  ENGINEERING  CONFERENCE 


Wednesday,  October  25  -  Continued 


4:30pm  -  4:55pm 

4:55pm  -  5:20pm 

Track  1 

Singleton 

System  Security 
Engineering 

3D1 

19880 

Engaging  the  DoD  Enterprise  to 

Protect  U.S.  Military  Technical 
Advantage:  Joint  Acquisition  Protection 
and  Exploitation  Cell  Update 

►  Mr.  Brian  Hughes, 

Department  of  Defense 

19798 

Using  Real  Options  Analysis  to 
develop  Resiliency  in  System  Security 
Architectures 

►  Mr.  Chris  D’Ascenzo, 

Defense  Acquisition  University 

Track  2 

Miller 

System  of  Systems 

3D2 

19736 

“Defense  Acquisition  System”  System 
of  Systems  Engineering 

►  Mr.  Larry  Harding, 

Idaho  National  Laboratory 

Track  3 

Von  Sternberg 

Digital  Engineering 
&  Model- 
based  Systems 
Engoneering 

3D3 

19763 

The  Digital  Engineering  Journey 

►  Mr.  Mathew  Hause, 

PTC 

19833 

Digitalization  of  Systems  Engineering 
-Examples  and  Benefits  for  the 
Enterprise 

►  Mr.  Sanjay  Khurana, 

Dassault  Systemes 

Track  4 

Gibson 

CREATE: 
Computational 
Research  & 
Engineering 
Acquisition  Tools 
and  Environments 
Engineering 

3D4 

19776 

Weapons  System  Innovation  through 
Workflow-based  Computational 
Prototyping 

►  Mr.  Loren  Miller, 

DataMetric  Innovations,  LLC 

19786 

Rotorcraft  Acquisition:  Development  of 
Modeling  and  Simulation  Procedures 

►  Dr.  Marvin  Moulton, 

U.S.  Army 

Track  5 

Seller 

Environment 
Safety  & 
Occupational 
Health 

3D5 

19770 

Assessing  the  impacts  of  Amended  Toxic  Substances  Control  Act  to  the  DoD  Mission  and  the  Defense  Industrial  Base 

Panel 

►  Ms.  Amy  Borman,  U.S.  Army 

►  COL  Joseph  Constantino  (SAF/IEE) 

►  Mr.  Shane  Esola,  DCMA 

►  Mr.  Jim  Rudroff,  (ODASN(E)) 

►  Dr.  Patricia  Underwood,  OASD(EI&E) 

CO 

o 

< 

Korman 

Systems 

Engineering 

Effectiveness 

3D6 

19762 

Decision-Driven  Product  Development 

►  Mr.  Matthew  Hause, 

PTC 

19830 

Are  We  Doing  Enough  in  Requirements 
Management? 

►  Dr.  Steven  Dam, 

SPEC  Innovations 

5:20pm  Adjourn 
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SYSTEMS  ENGINEERING  CONFERENCE 


Thursday,  October  26 

7:00am-5  :15pm  Registration 


7:00am-8:00am  Networking  Breakfast 


8:00am  -  8:25am 

8:25am  -  8:50am 

8:50am  -  9:15am 

9:15am  -  9:40am 

Track  1 

Singleton 

System  Security 
Engineering 

4A1 

19796 

Cyber  Systems  Risk  -  an 
Opportunity  for  Model  Based 
Engineering  &  Design 

►  Dr.  Jerry  Couretas, 

Booz  Allen  Hamilton 

19785 

Cybersecurity  As  An  Integral 
Part  of  Systems  Engineering 

►  Mr.  William  Decker, 

Defense  Acquisition 

University 

19741 

Security  at  Design  Time: 
Addressing  Resilience  in 
Mission  Critical  Cyber- 
Physical  Systems 

►  Mr.  Thomas  McDermott, 

Jr.,  Georgia  Tech  Research 
Institute 

19911 

Achieving  DoD  Software 
Assurance  (SwA) 

►  Mr.  Thomas  Hurt, 
Department  of  Defense 

Track  2 

DC 

LU 

_l 

_l 

Developmental 
Test  & 
Evaluation 

4A2 

19792 

An  Approach  to  Verification 
of  Complex  Systems 

►  Dr.  Wilson  Felder, 

Stevens  Institute  of 
Technology 

19925 

Improving  Distributed  Testing 
with  TENA  and  JM ETC 

►  Mr.  Ryan  Norman, 
TENA/JMETC 

19774 

Identifying  Requirements 
and  Vulnerabilities  for 
Cybersecurity;  Or  How  1 
Learned  to  Stop  Worrying 
and  Love  the  Six-Phase 
Cybersecurity  T&E  Process 

►  Mr.  David  Brown, 

Electronic  Warfare 

Associates  (EWA) 

19831 

How  Can  We  Use  V&V 
Techniques  in  Early  Systems 
Engineering? 

►  Dr.  Steven  Dam, 

SPEC  Innovations 

Track  3 

Von  Sternberg 

Engineered 

Resilient 

Systems 

4A3 

20009 

Digital  Engineering  and  ERS 

►  Mr.  Robert  Gold, 
Department  of  Defense 

19845 

ERS:  Influencing  Acquisition 
Innovation 

►  Dr.  Owen  Eslinger, 

U.S.  Army  Engineer 

Research  and  Development 
Center 

19907 

Scaling  Data  Analytics  for 

ERS 

►  Mr.  David  Stuart, 

U.S.  Army  Engineer 

Research  and  Development 
Center 

Track  4 

Gibson 

Create: 

Computational 
Research  & 
Engineering 
Acquisition 
Tools  and 
Environments 
Engineering 

4A4 

19887 

Multi-Disciplinary  Integration 
of  ModSim  for  Navy 
Applications 

►  Dr.  Greg  Bunting, 

Sandia  National 

Laboratories 

19729 

Academic  Deployment  of  the 
HPCMP  CREATE  Genesis 
Software  Package 

►  Dr.  Robert  Meakin, 

U.S.  DoD  HPCMP 

19875 

Secure  Web-Based 

Access  for  Productive 
Supercomputing 

►  Ms.  Laura  Ulibarri, 

Air  Force  Research 
Laboratory 

19800 

CREATE-SH  IHDE:  Workflow 
Process  Improvements 
for  Hydrodynamics 
Characterization  of  Ship 
Designs 

►  Mr.  Wesley  Wilson,  Naval 
Surface  Warfare  Center, 
Carderock  Division 

Track  5 

Seller 

Environment, 
Safety  & 
Occupational 
Health 

4A5 

19773 

Model  Based  Systems 
Engineering  (MBSE) 
Considerations  for 
Environment  Safety  and 
Occupational  Health  (ESOH) 

►  Mr.  Leo  Kilfoy, 

MSC  Software 

19772 

A  Pragmatic  Approach  to 
System  Modeling  for  Hazard 
Identification  and  Risk 
Management 

►  Mr.  Michael  Vinarcik, 

Booz  Allen  Hamilton 

19708 

Unmanned  System  (UxS) 
Safety  Engineering  Precepts 
-  an  OSD  Guide  -  update  of 
the  2007  OSD  UxS  Safety 
Guide 

►  Mr.  Michael  Demmick, 
NOSSA 

19754 

Divergent  Oscillating 

Refueling  Probe  on  the 
HH-60G  Pavehawk 

►  Mr.  Joseph  Jones, 
SAF/AQRE 

Track  6 

Korman 

Architecture 

4A6 

19820 

MOSA  Considerations 
in  Systems  Engineering 
Through  the  Lifecycle 

►  Ms.  Philomena 

Zimmerman, 

Department  of  Defense 

19821 

Implementing  a  MOSA  to 
Achieve  Acquisition  Agility 
in  Defense  Acquisition 
Programs 

►  Ms.  Philomena 

Zimmerman, 

Department  of  Defense 

19837 

Challenges  to  Implementing 
MOSA  for  Major  DoD 
Acqusition  Programs 

►  Mr.  Edward  Mosh insky, 
Lockheed  Martin 

Corporation 

19778 

Investigating  Approaches  to 
Achieve  Modularity  Benefits 
in  the  Defense  Acquisition 
Ecosystems 

►  Dr.  Navindran 
Davendralingam, 

Purdue  University 
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SYSTEMS  ENGINEERING  CONFERENCE 


Thursday,  October  26-  Continued 


9:40am-10:15am  Networking  Break 


10:15am  -  10:40am 

10:40am  -  11:05am 

11:05am  -  11:30am 

11:30AM  -11:55AM 

Track  1 

Singleton 

System  Security 
Engineering 

4B1 

19853 

Joint  NDIA  SSE  &  SwA 
Committee  and  Joint 
Federated  Assurance 

Center,  Government  SwA 

Gap  Analysis  Workshop 
Summary 

►  Ms.  Holly  Dunlap, 

Raytheon  Company 

19698 

Program  Manager’s 
Guidebook  for  Integrating 
Software  Assurance  into 
Defense  Systems  During  the 
System  Acquisition  Lifecycle 

►  Dr.  Kenneth  Nidiffer, 
Software  Engineering 

Institute 

19735 

Reducing  Software 
Vulnerabilities  -  The  “Vital 

Few”  Process  and  Product 
Metrics 

►  Mr.  Girish  Seshagiri, 

Ishpi  Information 
Technologies,  Inc. 

19910 

DoD  Joint  Federated 

Assurance  Center  (JFAC)  201 7 
Update 

►  Mr.  Thomas  Hurt, 

Department  of  Defense 

Track  2 

Miller 

Education  & 
Training 

4B2 

19813 

Shaping  the  Department 
of  Defense  Engineering 
Workforce 

►  Ms.  Aileen  Sedmak, 
Department  of  Defense 

19794 

Review  of  Best  Practices 
for  Technical  Leadership 
Development 

►  Dr.  Wilson  Felder, 

Stevens  Institute  of 
Technology 

19805 

Development  of  a  Defense 
Mission  Engineering 
Competency  Model 

►  Dr.  Nicole  Hutchison, 
Stevens  Institute  of 
Technology 

19789 

The  Capstone  Marketplace: 
Growing  our  Technical 

Workforce  through  Systems 
Oriented  Senior  Design 

Projects 

►  Ms.  Megan  Clifford,  Systems 
Engineering  Research  Center 

Track  3 

Von  Sternberg 

Engineered 

Resilient 

Systems 

4B3 

19844 

Tradespace:  Informed 

Decision  making  for 
Acquisition 

►  Mr.  Timothy  Garton, 
Engineer  Research  and 
Development  Center 

19834 

Building  an  Agile  Framework 
for  the  Analysis  of 
Environmental  Impacts  on 
Military  Systems 

►  Dr.  Dharhas  Pothina, 
Engineer  Research  and 
Development  Center 

19859 

Introducing  Lifecycle 

Cost  to  Early  Conceptual 
Tradespace  Exploration 

►  Mr.  Erwin  Bay  lot, 

Engineer  Research 
and  Development 

Center 

19806 

Overcoming  the  Government  - 
Industry  Collaboration  Hurdle 

►  Dr.  Patrick  Martin, 

BAE  Systems 

Track  4 

Gibson 

Create: 

Computational 
Research  & 
Engineering 
Acquisition 
Tools  and 
Environments 
Engineering 

4B3 

19694 

Software  Engineering 
for  Physics-based  HPC 
Applications  for  Engineering 
Design  and  Analysis  in 
CREATE 

►  Dr.  Richard  Kendall,  DoD 
HPCMP 

19703 

Verification  and  Validation  in 
CREATE  Multi-Physics  HPC 
Software  Applications 

►  Dr.  Lawrence  Votta, 

Brincos  Inc. 

19709 

DoD  Risk  Management 
Deficiencies... And  How  to 

Fix  Them 

►  Mr.  Richard  Sugarman, 

U.S.  Air  Force 

19724 

Tools  for  Acquiring  Highly 
Maintainable  Software- Intensive 
Systems 

►  Dr.  Barry  Boehm,  USC 

Track  5 

Seller 

Environment, 
Safety  & 
Occupational 
Health 

4B5 

19767 

Rapid  Equipping  - 
Immediate  Need  to  Equip 
and  Protect  Soldiers 

►  Mr.  George  Evans, 
Prospective  Technology  Inc. 
(SAAL-PE/PTI  ctr) 

19769 

ESOH  Risk  Management 
and  Applying  MIL-STD- 
882E  Principles  to  Programs 
that  Deviate  from  Standard 
Acquisition  Models 

►  Mr.  Jefferson  Walker, 

Booz  Allen  Hamilton 

19732 

Hazardous  Materials 

Risk  Management  Using 
MIL-STD-882E 

►  Ms.  Lori  Hales, 

Booz  Allen  Hamilton 

19836 

Leveraging  the  International 
Aerospace  Environmental 

Group  (IAEG)  Defense 

Acquisition  Materials 

Declaration  Process 

►  Ms.  Karen  Gill, 

Booz  Allen  Hamilton 

Track  6 

Korman 

Architecture 

4B6 

19780 

Cybersecurity  and  a  Modular 
Open  Systems  Approach 

►  Mr.  William  Decker, 

Defense  Acquisition 

University 

19743 

If  System  Architectures  are 

So  Useful,  Why  Don’t  We 

Use  Them  More? 

►  Mr.  Robert  Scheurer,  NDIA 
SE  Architecture  Committee 

19873 

A  Reverse  Chronology  of 
Evolutionary  Architecture  and 
Agile  Development 

►  Mr.  Thomas  Mielke, 

CACI  International  Inc. 

19903 

Efficient  Use  of  Enterprise 
and  System  Architecting  in 
Combined  Environment 

►  Dr.  Howard  Gans, 

Harris  Corporation 
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SYSTEMS  ENGINEERING  CONFERENCE 


Thursday,  October  26  -  Continued 

1 1  :55am  -  1  :00pm  Networking  Luncheon 


1:00pm  -  1:25pm 

1:25pm  -  1:50pm 

1:50pm  -  2:15pm 

2:15pm  -  2:40pm 

Track  1 

Singleton 

System  Security 
Engineering 

4C1 

19862 

Long-Term  Strategy  for 

DoD  Trusted  and  Assured 
Microelectronics  Needs 

►  Dr.  Jeremy  Muldavin, 
Department  of  Defense 

19747 

SSE  Abstract:  Developing 
Trust  For  a  Secure 
Microelectronics  Supply 

Chain 

►  Dr.  Michael  Fritze, 

Potomac  Institute  for  Policy 
Studies 

19731 

SSE:  Trusted 

Microelectronics  Joint 

Working  Group 

►  Dr.  Brian  Cohen,  Institute 
for  Defense  Analyses 

19700 

Managing  Risk  with  Trusted 
ASICs:  Introducing  to 
the  SSE  Community  a 
Guidebook  to  Using  Trusted 
Suppliers 

►  Mr.  Jim  Gobes,  Intrinsix 
Corp. 

Track  2 

DC 

LU 

_1 

_l 

Education  & 
Training 

4C2 

19811 

Version  1 .0  of  the  New 
INCOSE  Competency 
Framework 

►  Mr.  Don  Gelosh 

19515 

A  Proposed  Engineering 
Training  Framework  and 
Competency  Methodology 

►  Dr.  Eric  Dano, 

BAE  Systems 

19695 

Educating  Engineers  or 
Training  Technicians 

►  Mr.  Zane  Scott, 

Vitech  Corporation 

19734 

Solving  Cybersecurity 

Skills  Shortage  With 
Apprenticeships  & 
Certifications  -  A  Case 

Study 

►  Mr.  Girish  Seshagiri, 

Ishpi  Information 
Technologies,  Inc. 

Track  3 

Von  Sternberg 

Engineered 
Resilient  Systems 

4C3 

19783 

The  Language  of 

Complexity:  Ontology 
in  Systems  Design  and 
Engineering 

►  Mr.  Abe  Wu, 

Raytheon  Missiles 

19846 

Physics  and  Model  Based 
Aerodynamic  Design  and 
Analysis  at  GA 

►  Mr.  Pritesh  Mody, 

General  Atomics 

Aeronautical  Systems,  Inc. 

20050 

Automation  and  Integration 
for  Complex  System  Design 

►  Mr.  Scott  Radon,  Phoenix 
Integration 

19825 

Application  of  CREATE  Tools 
for  High  Fidelity  Design 

Space  Exploration 

►  Mr.  Antonio  De  La 

Garza,  Lockheed  Martin 
Aeronautics  Company 

Track  4 

Gibson 

Program 

Management 

4C4 

19751 

A  Capability  Value  Frontier 
in  Support  of  Acquisition 
Approaches  to  Enable 

Military  Effectiveness 

►  Dr.  Marilyn  Gaska, 
Lockheed  Martin 

Corporation 

19782 

Technical  Data  Package  and 
Intellectual  Property  Rights 

►  Mr.  William  Decker, 

Defense  Acquisition 

University 

19827 

Policy  Engineering:  Applying 
Systems  Engineering  to 
Develop  Better  Policies 

►  Dr.  Steven  Dam, 

SPEC  Innovations 

Track  5 

Seller 

Environment, 
Safety  & 
Occupational 
Health 

4C5 

19714 

DoD’s  REACH  Strategy  and 
its  Impact  to  Acquisition  and 
Sustainment 

►  Dr.  Patricia  Underwood, 
OASD(EI&E) 

19705 

Environmental  Liabilities  for 
DoD  Weapons  Systems 

►  Ms.  Patricia  Huheey, 
OASD(EI&E) 

19810 

Environmental  Life  Cycle 
Assessment  of  Commercial 
Transportation  Activities 

►  Ms.  Sheila  Neumann, 
University  of  Texas  at 
Arlington 

19699 

Life  Cycle  Assessment:  A 

Tool  for  Protecting  Defense 
Assets 

►  Dr.  Kelly  Scanlon, 
OASD(EI&E) 

CO 

o 

< 

£ 

Korman 

Architecture 

4C6 

19748 

Advancing  U.S.  Marine 

Corps  Warehouse 
Management  Operations 
Through  System 

Architecture  and  Analysis 

►  Mr.  Christopher 

Melkonian, 

Marine  Corps  Systems 
Command 

19828 

From  Architecture  to 
Operations  -  Using  Your 
Architecture  Work  in 
Operations 

►  Dr.  Steven  Dam, 

SPEC  Innovations 
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SYSTEMS  ENGINEERING  CONFERENCE 


Thursday,  October  26  -  Continued 

2:40pm  -  3:15pm  Networking  Break 


3:15pm  -  3:40pm 

3:40pm  -  4:05pm 

4:05pm  -  4:30pm 

Track  1 

Singleton 

System  Security 
Engineering 

4D1 

19864 

Field  Programmable  Gate  Array 
(FPGA)  Assurance 

►  Mr.  Ray  Shanahan,  Department  of 
Defense 

19891 

Using  Cyber  Resiliency  Frameworks 
to  Engineer  and  Manage  IT  Services 

►  Dr.  Subash  Katie, 

The  MITRE  Corporation 

19863 

Survey  of  Cyber  Security  Framework 
across  Industries 

►  Mr.  Ambrose  Kam, 

Lockheed  Martin  Corporation 

Track  2 

Miller 

Education  & 
Training 

4D2 

19756 

Teaching  Executable  Model-Based 
Engineering  (MBE):  Best  Practices 

►  Mr.  Matthew  Cotter, 

The  MITRE  Corporation 

19760 

The  Systems  of  Systems  (SoS) 

Primer:  A  Guide  to  SoS  for  all 

Expertise  Levels 

►  Ms.  Laura  Antul, 

The  MITRE  Corporation 

19865 

Breaking  Out:  Systems  Engineering 

To  Go 

►  Mr.  Zane  Scott, 

Vitech  Corporation 

Track  3 

Von  Sternberg 

Engineered 
Resilient  Systems 

4D3 

19712 

Implementation  of  Clustering  Analysis 
in  Engineered  Resilient  Systems  Tools 
for  Enhanced  Trade  Space  Exploration 
of  Military  Ground  Vehicles 

►  Mr.  Andrew  Pokoyoway, 

TARDEC 

19818 

Tradespace  Analysis  and  Exploration 
incorporating  Reliability,  Availability, 
Maintainability,  and  Cost 

►  Dr.  Lance  Fiondella, 

University  of  Massachusetts 

19741 

Security  at  Design  Time:  Addressing 
Resilience  in  Mission  Critical  Cyber- 
Physical  Systems 

►  Mr.  Thomas  McDermott, 

Georgia  Tech  Research  Institute 

Track  4 

Gibson 

Program 

Management 

4D4 

19847 

Proactively  Managing  Supplier 
Relationships  for  an  Integrated 

Product  Development  Program 

►  Ms.  Beth  Layman, 

Layman  &  Layman 

19932 

Improving  Efficiency  in  Assembly, 
Integration  and  Test  (AI&T) 

►  Mr.  Jeff  Juranek, 

The  Aerospace  Corporation 

19842 

“Other  Transactions”  -  An  Alternative 
to  Business  as  Usual 

►  Mr.  Richard  Dunn, 

Strategic  Inst  for  Innovation  in  Govt 
Contracting 

Track  5 

Sellier 

Environment, 
Safety  & 
Occupational 
Health 

4D5 

19766 

ESOH  Management  in  Agile  and 

Rapid  Acquisitions  Using  Digital 
Engineering 

►  Mr.  Sherman  Forbes, 

SAF/AQRE 

Track  6 

Korman 

Enterprise  Health 
Management 

4D6 

19523 

Mission-Based  Forecasting  for  the 
Sustainment  Enterprise 

►  Col  Greg  Parlier,  USA  (Ret.), 

GH  Parlier  Consulting 
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SYSTEMS  ENGINEERING  CONFERENCE 


Thursday,  October  26  -  Continued 


4:30pm  -  4:55pm 

4:55pm  -  5:20pm 

Track  1 

Singleton 

System  Security 
Engineering 

19722 

The  Systems  Challenges  of 
Cybersecurity 
►  Mr.  Jeffery  Zili, 

Vitech 

19895 

Modeling  Cyber  Security 

►  Mr.  Ambrose  Kam, 

Lockheed  Martin  Corporation 

4D1 

Track  2 

cc 

LU 

-1 

_l 

Education  & 
Training 

19914 

Bridging  the  Gap  to  MBSE 

►  Mr.  James  Baker, 

Sparx  Systems 

19719 

Introducing  Cyber  Resiliency  Concerns 
Into  Engineering  Education 

►  Mr.  Thomas  McDermott, 

Georgia  Tech  Research  Institute 

4D2 

Track  3 

Von  Sternberg 

Engineered 
Resilient  Systems 

4D3 

19781 

Additive  Manufacturing  -  Challenges... 
Program  Manager 

►  Mr.  William  Decker, 

DAU  Huntsville 

20051 

Model-Based  Engineering: 

Opportunities,  Risks,  and  Best 

Practices 

►  Dr.  Marc  Halpern, 

Gartner,  Inc. 

5:20pm  Adjourn  Conference 
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SILVER  SPONSORS 


At  IBM  Research,  we  invent  things  that  change  the  world.  We  are  pioneering  promising  and  disruptive  technologies  that  will  transform  industries 
and  society,  including  the  future  of  Al,  blockchain  and  quantum  computing. 

We  are  driven  to  discover.  We  are  home  to  more  than  3,000  researchers  in  1 2  labs  located  across  six  continents.  Scientists  from  IBM  Research 
have  produced  six  Nobel  Laureates,  1 0  U.S.  National  Medals  of  Technology,  five  U.S.  National  Medals  of  Science,  6  Turing  Awards,  1 9  inductees 
in  the  National  Academy  of  Sciences  and  20  inductees  into  the  U.S.  National  Inventors  Hall  of  Fame. 

Our  teams  are  pushing  the  boundaries  of  science  to  uncover  tomorrow’s  breakthroughs  for  national  security,  economic  growth  and  jobs.  We  are 
especially  focused  on  microelectronics  as  a  national  critical  resource.  The  semiconductor  industry  is  a  foundational  industry  for  modern  society. 
Semiconductors  enable  all  electronics;  they  are  at  the  base  of  the  electronics  food  chain  and  make  digital  life  -  every  electronics  system  in  the 
world  -  possible.  Technological  leadership  in  semiconductor  research,  development,  design  and  manufacturing  is  vital  for  economic  growth  and 
especially  for  national  security. 


LOCKHEED  MA^RtTn^^ 

"Headquartered  in  Bethesda,  Maryland,  Lockheed  Martin  is  a  global  security  and  aerospace  company  that  employs  approximately  97,000 
people  worldwide  and  is  principally  engaged  in  the  research,  design,  development,  manufacture,  integration  and  sustainment  of  advanced 
technology  systems,  products  and  services." 


Raytheon 

Raytheon  Company  is  a  technology  and  innovation  leader  specializing  in  defense,  security  and  civil  markets  throughout  the  world.  With  a  history 
of  innovation  spanning  more  than  90  years,  Raytheon  provides  state-of-the-art  electronics,  mission  systems  integration  and  other  capabilities 
in  the  areas  of  sensing;  effects;  and  command,  control,  communications  and  intelligence  systems;  as  well  as  a  broad  range  of  mission  support 
services. 
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1.  What  Is  a  Policy? 

2.  How  Can  We  Apply  SE  to  Improve  Policies? 

3.  How  Can  We  Implement  this  Approach  without  Scaring 
Policy  Makers? 


1.  WHAT  IS  A  POLICY? 
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What's  a  Policy 


INNOVATIONS 


•  Lot's  of  definitions,  but 
the  "Business 
Dictionary"  shows  the 
key  elements 
highlighted 

o  Guiding  principles 

o  Organizational 
governance 

•  But  what  is  it  in 
Systems  Engineering 
terms? 
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policy 


Related  Terms  Definitions  (3) 


<  > 


See  Examples  I  Cite  Term  I  Add  to  Flashcards 


conditional  sal... 
ordinary  regist.*. 
consumerism 
full  theft  cove.« 
policy  reserve 


1,  Politics:  {1)  The  basic  principles  by  which  a  government  is  guided. 

(2)  The  declared  objectives  that  a  government  or  party  seeks  to  achieve  and 
preserve  in  the  interest  of  national  community.  See  also  public  policy. 

2,  Insurance:  The  formal  contract  issued  by  an  insurer  that  contains  terms  and 
conditions  of  the  insurance  cover  and  serves  as  its  legal  evidence. 

3,  Management:  The  set  of  basic  principles  and  associated  guidelines, 
formulated  and  enforced  by  the  governing  body  of  an  organization,  to  direct 
and  limit  its  actions  in  pursuit  of  long-term  goals.  See  also  corporate  policy. 


http:// www.  businessdictionary,  com/definition/policy.html  accessed  10/9/2017 
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•  Policies  contain  requirements  and  constraints  for  the 
organization 

•  Those  requirements  and  constraints  are  allocated  or 
traced  to  different  parts  of  the  organization 

•  Policies  also  frequently  contain  processes  or 
procedures  which  are  essentially  implementation 
scenarios 


Why  not  apply  systems  engineering  techniques  to  analyze  these 
policies  to  make  sure  they  work  prior  to  implementation? 


2.  HOW  CAN  WE  APPLY  SE  TO  IMPROVE  POLICIES? 
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Apply  Requirements  Analysis 

•  Treat  the  policy  draft(s)  as  a  requirements  document 

•  Analyze  for  quality  (clarity,  completeness,  etc.) 

•  Enhance  the  text  using  these  quality  criteria 

•  Use  a  "document  view"  for  presentation  to  stakeholders 

•  Capture  comments  in  tool  and  produce  "comment  matrix" 
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RA:  Treat  the  policy  draft(s)  as  a  requirements 

document 
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•  Import  documents 
into  a  requirements 
analysis  tool 

•  Break  paragraphs  into 
individual 
requirements  for 
analysis 

•  Note  many 
statements  may  not 
be  written  like  a 
requirements,  but  still 
are  requirements 
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Import  Analyzer:  Policy  Engineering  Example 


Supported  File  Types 


Word  (.docx)  Innoslate  Export  (.xml)  Excel  (.csv)  Rational  DOORS  (.csv)  Plain  Text  (.pdf,  .txt,  etc..) 

Importing  a  Microsoft  Word  (.docx)  File 


More  O 


Uploading  a  DOCX  file  via  the  wizard  below  lets 

o  Configure  Q  Upload 

Configure  Settings 

Select  the  default  class  you’d  like  analyzer 
Requirement 


O  Ensure  number  of  parent  is  included  in  c 
Automatically  re-number  the  entire  doci 
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•  Microsoft  Word  built-in  styles  (Heading  1  th 

•  If  the  Statement  or  Requirement  class  or  an 
be  navigated  to  Requirements  View  upon  si 

•  An  Artifact  entity  will  be  created  and  added 

Troubleshooting  Tips: 

•  If  you  encounter  problems  parsing  your  doc 

•  If  problems  persist,  try  importing  via  the  Pla 
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»  Rationale 


DoDM.3020.V1  .E2.1 .  CHAIRMAN  OF  THE  JOINT  CHIEFS  OF 
STAFF 

The  Chairman  of  the  Joint  Chiefs  of  Staff  shall  provide  to  the  ASD(HD&ASA),  Heads  of  the  DoD  Components,  and 
DISLAs  a  list  of  recommended  DCAs,  submitted  annually  and  when  changes  occur,  based  on  the  TCA  lists 
provided  by  the  Combatant  Commands,  Defense  Agencies,  Military  Departments,  and  the  DISLAs. 

DoDM.3020.V1  .E2.2.  COMMANDERS  OF  THE  COMBATANT 
COMMANDS 

The  Commanders  of  the  Combatant  Commands  shall,  within  their  respective  regional  or  functional  area  of 
responsibility: 

DoDM.3020.V1  .E2.2.a.  Conduct  analyses  of  command  missions  and 
mission  essential  tasks 

Conduct  analyses  of  command  missions  and  mission  essential  tasks  (METs)  with  their  associated  conditions 
and  standards,  and  provide  results  to  appropriate  DoD  Component  and  DISLA  DCIP  offices  of  primary 
responsibility  (OPRs)  to  support  TCA  identification  in  accordance  with  this  Volume. 

DoDM.3020.V1  .E2.2.b.  Coordinate  and  assist  with  additional  DoD 
Component  and  DISLA 

Coordinate  and  assist  with  additional  DoD  Component  and  DISLA  analyses  of  command  missions  and  related 
capabilities  to  identify  TCAs  necessary  to  execute  these  missions. 

DoDM.3020.V1  .E2.2.C.  Validate  TCAs  submitted  by  the  DoD 
Components  as  critical  to  the  fulfillment  of  their  assigned  missions 

Validate  TCAs  submitted  by  the  DoD  Components  as  critical  to  the  fulfillment  of  their  assigned  missions  and 
submit  a  compiled,  validated  list  of  TCAs  to  the  Chairman  of  the  Joint  Chiefs  of  Staff  annually  and  when 
changes  occur. 

DoDM.3020.V1  .E2.3.  SECRETARIES  OF  THE  MILITARY 
DEPARTMENTS;  COMMANDER,  U.S.  SPECIAL  OPERATIONS 
COMMAND  (USSOCOM);... 

SECRETARIES  OF  THE  MILITARY  DEPARTMENTS;  COMMANDER,  U.S.  SPECIAL  OPERATIONS  COMMAND 
(USSOCOM);  CHIEF,  NATIONAL  GUARD  BUREAU  (in  coordination  with  the  Secretaries  of  the  Army  and  Air  Force 
and  in  consultation  with  the  National  Guard  Adjutants  General);  AND  DIRECTORS  OF  DEFENSE  AGENCIES  AND 
DoD  RELD  ACTIVITIES 

DoDM.3020.V1  .E2.3.a.  Identify  TCAs  in  support  of  assigned  missions 

Identify  TCAs  in  support  of  assigned  missions,  METs,  and/or  core  functions  and  provide  analysis  results  to  the 
Chairman  of  the  Joint  Chiefs  of  Staff  DCIP  OPR.  Coordinate  with  other  DoD  Component  Heads  and  DISLAs  as 
necessary  to  determine  scope  and  parameters  of  their  missions,  METs,  and  core  functions  assigned  to  the 
organization  for  execution  to  identify  TCAs. 

DoDM.3020.V1  .E2.3.b.  For  DCI,  provide  and  maintain  DoD 
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RA:  Analyze  for  quality  (clarity,  completeness,  etc.) 


•A  number  of  the  standard  quality  factors  apply  directly  to 
(clear,  complete,  consistent,  and  correct) 
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•Other  may 
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apply,  depending  on  the  specific  policy  (Design,  Feasible, 
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DoDD. 3020.4.  POLICY 

It  is  DoD  policy  that: 


(Last  Modified:  10/10/2017)  -  Rationale 

N/A 


_®  DoDD.3020.4.;Name 

+  -  B  I  IZ  -S-  i  K  ~  S  ~  ^  </> 

Coordination  on  the  risk  management  of  defense  critical  infrastructure  (DCI)  shall  be  accomplished  with  other  Federal  departments  and  agencies;  State,  local,  regional, 
territorial,  and  tribal  entities;  the  private  sector;  and  foreign  countries,  as  appropriate. 


DoDD.3020.4.b.  DCI  risk  management  actions  shall: 

DoDD. 3020.4. b.(1 )  Be  coordinated  and  accomplished  by  responsible  authorities. 

DoDD. 3020.4. b. (2)  Support  incident  management. 

DoDD. 3020.4. b. (3)  Protect  DCI-related  sensitive  information. 

DoDD. 3020.4. c.  The  DCIP  shall  coequally  complement  and  not  be  subordinate  to  other  DoD  programs,  functions,  and  activities  that  contribute  to  mission 
assurance  through  risk  management. 

DoDD.3020.4.d.  The  DCIP  shall: 

DoDD.3020.4.d.(1 )  Determine  the  risks  to  DCI. 

DoDD. 3020.4. d. (2)  Implement  DoD-wide  procedures  to  respond  to  risks  to  DCI  and  work  with  other  Federal  departments  and  agencies;  State,  local, 
regional,  territorial,  and  tribal  entities;  the  private  sector,  and  foreign  countries,  as  appropriate. 
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RA:  Enhance  the  text  using  these  quality  criteria 
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Coordination  on  the  risk  management  of  defense  critical  infrastructure  (DC!)  shall  be  accomplished  with:  other 
Federal  departments  and  agencies;  State,  local,  regional,  territorial,  and  tribal  entities;  the  private  sector;  and 
foreign  countries,  as  appropriate. 


None  to  display. 


•  Enhance  the  grammar 
•Simplify,  where  possible 

•  Break  into  separate  requirements,  if  desirable 
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Hide  information  that  may 
confuse  a  reader/viewer 

o  e.g.,  columns  with  quality  score, 
labels,  other  attributes 

Readers  can  then  view  it  as 
they  would  a  document  in  MS 
Word,  but  any  comments  and 
other  information  would  be 
accessible  at  the  paragraph 
level 

Hyperlinks  can  be  provided  to 
guide  them  to  other 
documents 
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[1  1  DoDD  3020.40 

(Last  Modified:  10/10/2017) 

-  DoDD.3020.1 .  PURPOSE 

This  Directive: 

DoDD.3020.1  .a.  Updates  renames,  and  reissues  DoD  Directive  (DoDD)  3020.40  (Reference  (a))  to  assign 
responsibilities  for  the  Defense  Critical  Infrastructure  Program  (DCIP). 

Updates  renames,  and  reissues  DoD  Directive  (DoDD)  3020.40  (Reference  (a))  to  assign  responsibilities  for  the  Defense  Critical  Infrastructure  Program  (DCIP). 

DoDD.3020.1  .b.  Establishes  policy  and  assigns  responsibilities  for  the  execution  of  roles  assigned  to  the 
Department  of  Defense  pursuant  to  Homeland  Security  Presidential  Directive  7 

Establishes  policy  and  assigns  responsibilities  for  the  execution  of  roles  assigned  to  the  Department  of  Defense  pursuant  to  Homeland  Security  Presidential  Directive  7  and 
DoD  Instruction  5220.22  (References  (b)  and  (c)),  and  ensures  consistency  with  applicable  provisions  of  the  National  Infrastructure  Protection  Plan  (Reference  (d))  and 
compliance  with  applicable  provisions  of  part  29  of  title  6,  Code  of  Federal  Regulations  (Reference  (e)). 

DoDD.3020.1  .c.  Implements  Reference  (b),  which  assigns  critical  infrastructure  and/or  key  resource  (CI/KR) 
responsibilities  to  the  Department  of  Defense. 

Implements  Reference  (b),  which  assigns  critical  infrastructure  and/or  key  resource  (CI/KR)  responsibilities  to  the  Department  of  Defense. 

DoDD.3020.1  .d.  Designates  the  Defense  Infrastructure  Sector  Lead  Agents  (DISLAs)  and  assigns  their 
specific  roles  and  responsibilities. 

Designates  the  Defense  Infrastructure  Sector  Lead  Agents  (DISLAs)  and  assigns  their  specific  roles  and  responsibilities. 

-  DoDD. 3020. 2.  APPLICABILITY 

“  DoDD. 3020. 2. a.  This  Directive  applies  to: 

DoDD.3020.2.a.(1 )  OSD  the  Military  Departments,  the  Office  of  the  Chairman  of  the  Joint  Chiefs  of  Staff  and  the  Joint  Staff,  the  Combatant  Commands,  the  Office 
of  the  Inspector  General  of  the  Department  of  Defense,  the  Defense  Agencies,  the  DoD  Field  Activities,  and  all  other  organizational  entities  in  the  Department  of  Defense 
(hereafter  referred  to  collectively  as  the  "DoD  Components"). 

DoDD. 3020. 2. a. (2)  The  DISLAs  identified  in  section  15  of  Enclosure  2  of  this  Directive. 

DoDD.3020.2.b.  Nothing  herein  shall  be  interpreted  to  subsume  or  replace 

Nothing  herein  shall  be  interpreted  to  subsume  or  replace  the  responsibilities,  functions,  or  authorities  of  the  OSD  Principal  Staff  Assistants  (PSAs),  the  Secretaries  of  the 
Military  Departments,  the  Chairman  of  the  Joint  Chiefs  of  Staff,  the  Commanders  of  the  Combatant  Commands,  or  the  Heads  of  the  Defense  Agencies  or  of  the  DoD  Field 
Activities  as  prescribed  by  law  or  DoD  guidance. 

DoDD.3020.3.  DEFINITIONS 

See  Glossary. 

DoDD. 3020.4.  POLICY 

It  is  DoD  policy  that: 
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(DISLAs)  and  assigns  their  specific  roles  and  responsibilities. 


Designates  the  Defense  Infrastructure  Sector  Lead  Agents 
(DISLAs)  and  assigns  their  specific  roles  and  responsibilities. 

Statement 

DoDD.3020.1.  PURPOSE 
Added 


Model  Processes  and  Procedures 


SPEC 

INNOVATIONS 


•  Review  policies  for 
processes  and 
procedures 

•Create  a  functional 
model 

•Trace  back  to 
requirements 

•  Enter  time  distributions 

•  Associate  costs 

•Allocate to  performing 
elements 


MENU  -  Dashboard  Requirements 


Diagrams  Import  Analyzer 


Attributes  Metadata 

Action 

Name 

Compile  and  Release  DoD-wide  TC< 

Number 
STEP  6 

Description 

+  -  B  /  U  -S-  : 


©Open'-  B  /  A  T  «/  &  </>  Script 


- 


STEP  1 

Decompose 
^  Mission  and 
Identify 
Required 
Capabilities 


“1  STEP  2 

Identify' 


Joint  Staff  Compilation  and 
Release  of  the  DoD-wide  TCA  Listj 


Identify  Task  — 
Assets 


STEP  3 


Nominate 
and  Submit 


Duration 

Triangular 


Validate 

TCAs 


~|  STEPS 

^  Subn 


Submit  — | 

Validated  Lists 


STEP  6 

Compile  and 
1  Release 
DoD-wide  TCA 
List 


c  1 

Start 

Date 

Time 

Percent  Complete 
0 
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Share  Policy  Engineering  Exa...  -  Steven  Dam  - 


STEP  7 

Conduct 
Interdependency 
Analysis 


V 


STEP  8 

,  Nominate 

Potential 

DCAs 

STEP  9 

Review  and 

^  Approve  of  ■ 

Nominated 

DCAs 

x  e* 
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Capture  Organization  Information  in  Database 


SPEC 

INNOVATIONS 


Create  hierarchy 

Allocate  actions  and 
requirements  as 
appropriate 


Attributes  Metadata 

Asset 

Name 


Dashboard  Requirements  Database  Diagrams  Import  Analyzer 


©  Remove  - 


Share  Policy  Engineering  Exa...  ▼  Steven  Dam  - 


©  Open  ▼  B  I  A  T  f  * 


J-3 


Number 

3 

Description 

+  -  B  I  U  ^  • 

The  Director  for  Operations  (DJ-3) 
assists  the  Chairman  in  carrying 
out  responsibilities  as  the  principal 
military  advisor  to  the  President 
and  Secretary  of  Defense, 
developing  and  providing  guidance 
to  the  combatant  commanders  and 
relaying  communications  between 
the  President  and  the  Secretary  of 
Defense  and  the  combatant 
commanders  regarding  current 
operations  and  plans. 


US 

Department 
of  Defense 


National 

Guard 


Chairman, 
Ijoint  Chiefs  ofl 


— ►  ASD(H  D&ASA) 

L . ■ . .J 

< 

►  Comptroller 

[2 

-  J-2 

Combatant 

Commanders 


3  - 

>3  | 


-•) - •) 


Joint  Staff 
OPR 


j-4 


>  CENTCOM 

1  1 


TRANSCOM 


AFRICOM 


>  SOCOM 


>  JFCOM 

1  1 


PACOM 


*  - 


MILDEP 


DISLA 

(Agencies) 


Services 


100%  ~  +  X  Gt 
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Allocate  Tasks  to  Organizational  Elements 


SPEC 

INNOVATIONS 


Create  relationships  between 
tasks  and  organizations, 
according  to  policies 

Use  this  information  to 
determine  if  the  correct 
organizations  are  being 
correctly  tasked 

Suggest  changes,  as 
appropriate,  and/or  identify 
risks  to  the  organization  and 
mitigation  strategies 


MENU  -  Dashboard  Requirements  Database  Diagrams  Import  Analyzer 


Matrix  Comments 

Target  Entity 
CAIP  Process 
Target  Relationship 

performs 


US  De...  performs  CAIP  ... 

Hierarchical  Comparison  Matrix 

0  US  Department  of  Defense 


1  ©  Open  -  A  Report  ▼  +  Add  Column 

/  y  ,, 
///*  /V 

J?  ^  ^  .-s  .a* 

y  y  y  y  y  y  y  y 

v?  ^  ^  ^  . 

°  %  %  *  *  *  *  %  % 

w  / 

>•  e«° 

j?  A 

/  y 

V 

0  US  Department  of  Defense 

1  Services 

X 

X 

X 

X 

X 

2  National  Guard  Bureau 

X 

X 

T 

X 

T 

3  OSD 

X 

3.1  ASD(HD&ASA) 

X 

3.2  Comptroller 

X 

4  Chairman,  Joint  Chiefs  of  Staff 

X 

4.1  J-1 

X 

4.2  J-2 

X 

4.3  J-3 

X 

4.3.1  Joint  Staff  OPR 

X 

X 

id 

X 

X 

X 

X 

<  4.4  J-4 

X 

4.5  J-5 

X 

4.6  J-6 

X 

4.7  J-7 

X 

4.8  J-8 

X 

5  Combatant  Commanders 

X 

X 

X 

X 

X 

5.1  CENTCOM 

X 

X 

X 

X 

X 

5.2  TRANSCOM 

X 

X 

H 

X 

5.3  AFRICOM 

X 

X 

X 

X 

X 

5.4  SOCOM 

H 

X 

X 

X 

X 

5.5  JFCOM 

X 

X 

X 

X 

X 

5.6  PACOM 

X 

X 

H 

X 

H 

5.7  STRATCOM 

X 

X 

X 

X 

X 

5.8  SOUTHCOM 

H 

X 

3 

X 

3 

5.9  NORTHCOM 

X 

X 

X 

X 

X 

5.10EUCOM 

X 

X 

X 

X 

T 

6  DISLA  (Agencies) 

X 

X 

X 

30  per  page 
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I N  N  □  VAT  I  □  N  S 


Verify  Processes  Work  through  Simulation 


•  Uses  timing  and  cost 
information  for  each 
step 

•Distributions  in  time 
and  cost  provide  a 
more  realistic  range 
of  the  process 

•These  distributions 
also  provide  a 
measure  of  cost  and 
schedule  risk 
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3.  HOW  CAN  WE  IMPLEMENT  THIS  APPROACH 
WITHOUT  SCARING  POLICY  MAKERS? 


SPEC 

INNOVATIONS 
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Implementation  Strategy 


INNOVATIONS 


•  Don't  tell  them  you  are  doing  systems  engineering 

o  Most  people  think  systems  engineering  only  applies  to  hardware  and 
software 

•  Perform  the  analysis,  but  only  show  results  in  a  form  that  they  will 
easily  accept 

o  No  UML,  SysML,  IDEFO,  etc.  drawings 

o  Simple  summaries  of  changes  (i.e.,  document  markups  and  text  summaries) 
o  No  engineering  jargon! 

•  Wait  for  them  to  ask  how  you  got  the  results 

o  Then  just  show  them  the  bare  minimum  of  SE  information 
o  Once  they  buy  into  these,  you  can  start  show  them  more 
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Summary 


SPEC 

INNOVATIONS 


Systems  engineering  can  dramatically  improve  policy 
development  and  implementation 

You  must  work  fast  in  doing  your  analysis  -  use  multi-purpose 
tools  with  analytics  to  speed  up  your  analysis  and  delivery 

Only  show  results,  not  how  you  got  there  ...  until  necessary 
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High  Performance  Computing  Portal 

Lowering  Barriers  /  Modern  HPC  Ecosystems 

NDIA  20th  Annual  Systems  Engineering  Conference 

Oct  23-26,  2017 

DOD _ 

HPq 

MODERNIZATION  PROGRAM 


Ms.  Laura  J.  Ulibarri,  Maui  High  Performance  Computing 
Center  Director 

Approved  for  Public  Release  10-0ct-2017 


HPC  Portal 


MODERNIZATION  PROGRAM 


•  Secure,  Web-based  Access  to  DoD  HPC  Assets 

•  End-to-End,  Full-Featured,  Web-Based  Workflow 

•  Highly  Productive  User  Experience 

—  Enabling  Non-Traditional  Users  &  Users  with  Constrained 
Desktops 


•  Transformative,  Successful,  Growing,  Agile 

•  Enables  3rd  Party  Developers  &  Innovative 
Applications 

—  A  Simple  Services  API  Abstracts  the  HPC  Workflow 


Easy,  Secure,  &  Powerful:  Demolishes  entry  and  access 

barriers  to  DOD  HPC  Services 
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Secure  Sign  On 

DoD-Hosted  OpenID  2-Factor  Logon 

No  User  Signups 


d 


OpenID 


“Zero  Footprint”  Browser 

Access 

No  Client  Installs  /  Configurations 
No  Kerberos  Kit  Required 


Software  as  a  Service  (SaaS) 

Instant  Updates  to  Users 
Manage  Access  through  Accounts 
Enforces  Access  Controls 
Access  from  Any  Network 
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Each  DoD  Supercomputing  Resource 
Center  has  a  Portal 


MODERNIZATION  PROGRAM 


i  Secure  https://centers.hpc.mil/portal/ 


Home  About  Systems  For  Users  News  &  Publications 


User  Dashboard 


Search 


Search 


HPC  Help  Desk 
Feedback 


|  Portal  Home 
Portal  Overview 
FAQs 

Portal  Applications 
Technical  Papers 
Posters 

Video  Demonstration 
Apply  for  an  Account 
Gallery/C  RE  ATE 
Contact  Us 


HPC  Portal 


HPC  Portal  at  HPC  Portal  at  HPC  Portal  at  HPC  Portal  at 


AFRL  ARL  ERDC  NAVY 

If  you  have  an  account  on  any  system  at  a  DSRC,  you  also  have  a  Portal  account  at  that  DSRC.  Click  on  the  appropriate  DSRC  link  above  to  access  its 
HPC  Portal. 

The  HPC  Portal  provides  you  with  native  web  tools  that  allow  command  line  access  and  ability  to  manage  files  and  jobs  from  a  web  browser.  The  HPC 
Portal  also  provides  custom  web  applications  that  allow  you  to  submit  jobs  from  a  web  interface.  The  HPC  Portal  supports  pre/post-processing  and  data 
visualization  by  making  DSRC  hosted  desktop  applications  that  are  not  web-based  accessible  from  a  web  browser. 


https://portal.hpc.mir 

*  Note:  DoD  issues  their  own  certificates,  you  may  get  an  “unsafe  error” 
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MODERNIZATION  PROGRAM 


HPC  Portal  Adoption:  APPLICATIONS 


w 


E 


Total  Webapp  Starts  (last  52  weeks) 


1608 

1400 
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0 


oo 

CL 
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c 

J3 
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L. 

31 

C 

iH 
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u 

D 

m 

1 0 

m 

1 0 

Cl 

3 

3 

E 

Crt 

o 

E 

a 

n 

Li. 

E 

E 

E 

“J 

Webapp  Starts  (7/2  -  7/16)  HP©  ^\pp)D8©S)ft8®[n) 


H 


{Mm  (taiOsM) 

■  webshell 

■  filemanager 

■  v-apps 

■  matlab 

■  paraview 

■  jms 

■  bp3i 

■  sentri 


filemanager,  761 


Portal  for  Users 


MODERNIZATION  PROGRAM 


*  Job  Creation,  Submission,  Monitoring,  Termination, 
Visualization 

—  Virtual  Applications 

•  Pre/Post-Processing  &  Visualization 

•  Access  any  X-Based  Application 

•  Quickly  automate  repetitive  workflows 

—  Native  Web  Applications 

•  Customized  User  Interfaces  for  data  entry,  control  and  analysis 

•  Utilities 

—  Command  Line  Interface 

—  File  Management 

—  User  Account  Information 

—  Help  &  Forums 
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HPC  Portal-Hosted  Web  Applications 


MODERNIZATION  PROGRAM 


•  CREATE-AV  Web  Kestrel 

•  CREATE-RF  WebSENTRi 

•  CREATE-MG  WebCapstone 

•  CREATE-GV  Mercury/MAT 

•  JMS/ARCADE  (Space  Situational  Awareness) 

•  BP3I  (Blast  Protection  Institute) 

•  ParaView  Web  (3D  Visualizations  on  Utility  Servers) 

•  Jupyter  Notebooks  (on  HPC  Resources) 

•  Distributed  Matlab 

•  Collaboration  /  Repository  Management — in  work 


50, 000+  application  starts  and  growing! 
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e 


i  Secure  https://portal.arl.hpc.mil/portal-framework-widgets-vaadin 


Applications  File  Manager  Job  Manager  Support  Gateway  About  Me  Log  Out 


File  Menu 

JOB  NAME 
job35 

NAVIGATION 
Setup  Matlab 
Input  Files 

Track  Files 


tl 

Create  Copy 


a 


>/ 

Submit  Job 


Reload  Project 


? 

Help 


P 

Feedback 


<s> 


Parametric  Iteration  6 
Parametric  Iteration  7 
Parametric  Iteration  8 
Parametric  Iteration  9 
Parametric  Iteration  10 
Parametric  Iteration  11 
Parametric  Iteration  1 2 
Parametric  Iteration  13 
Parametric  Iteration  14 
Parametric  Iteration  1 5 
Parametric  Iteration  16 


Debug  Info 


NAME 

i 

Matlab  Compile  Phase 

Parametric  Iteration  1 

Parametric  Iteration  2 

Parametric  Iteration  3 

Parametric  Iteration  4 

F 

Parametric  Iteration  5 

restored.jpg 


T.  START  TIME  (IF  AVAIL 


» 


V' 

V 


Slide  Show 


Name:  restored.jpg 
Size:  1.410  MB 

Date:  2017-07-18  09:31:08  EDT 

Path:  /p/cwf s/randyg/ .portal_work_space/mil 

H  Download 


Native  Web  Apps:  File  Manager 


MODERNIZATION  PROGRAM 


0^0 

(ZE  li  portal.mhpcc.hpc.mil 


Files  -  HPC  Portal 


QQ 


AF  Portal  DRC  Sign-On  Page  DoD  ▼  DRC  1 


HPC  Centers  -  For  Users  -  HPC  Portal 


T 


Files  -  HPC  Portal 


1“ 


Support  -  HPC  Portal 


A  Apps  ^  Files  Djobs  ®  Support  ^Portal  Gateway  About  Me  I  ■  Rh°nda  Jean  Vickery  sign  c 


Utility  Server 

▼  *mm 

►  :0  data 

►  y  portal-videos 

►  *  tarfiles 

►  0 CENTER 

►  0  WORKDIR 

►  0* 

Riptide 

► 

►  0  CENTER 

►  &  WORKDIR 

►  0\ 


& 

Refresh 


New  Folder 


O 

L_r 

Upload 


Upload  Status  Unar.;h>'/* 


□ 

Show  Hidden  Files 

Download 


pt-riptide:///gpfs/home/vickerrj 


NAME 

TYPE 

a  FILESIZE 

□ 

comb.q 

FILE 

940.5  KB 

D 

comb.xyz 

FILE 

564.3  KB 

D 

fv_backup_restartdat 

FILE 

1.1  KB 

D 

fv_backup_restartfvx 

FILE 

6.2  KB 

D 

fv_backup_restart.map 

FILE 

279  bytes 

D 

fv_backup_restartprd 

FILE 

282  bytes 

i 

fv_backup_resta  rivet 

FILE 

390  bytes 

* 


pplications 


MODERNIZATION  PROGRAM 


Remote  Display  of  X-Based  Applications 


Connected  (encrypted)  to:  Capstone503 


capstoneGui 


File  Edit  Points  Curves  Surfaces  Solids  Breps  Advanced  Mesh  Attribution  CREATE  User-Plugins  Views  Config/Help 


lIVpVFQl^Cikl 

» 

xz  XI 

■  „ 

■  

B*1 

| J]  JP\  y Vector  ▼!! xyz  <j  f  <)  N/A 


’’Capstone”  Hosted 
as  Virtual 
Application 


?  Mode 


m 


Base  Radius  =  2  000000 

Top  Radius  =  1  000000 
Length  =  2  000000 

Direction  =  0  000000  0  000000  1  000000 
Number  of  Sides  =  10 


Process  [tessellation]  started 
Process  [tessellation] 
Process  [CreateFrustum] 


randygQpvQl- 


File 

Edit  View 

Search  Terminal 

Help 

1 

Tasks : 

:  355  total, 

1  running 

,  353 

sleeping. 

0  stopped, 

L  zombie  I*! 

Cpu ( s ) 

:  0 . 2%us, 

0, 

.  2%sy,  O.i 

0%ni, 

99.6% id,  0 

. 0%wa, 

0 . 0%hi( 

0 . 0%s i,  0.0%st 

Mem: 

24596832k 

total, 

24210272k  used. 

386560k  f re< 

e,  124512k  buffers 

Swap : 

26836988k 

total. 

13056k  used. 

26823932k  fre< 

e,  22279540k  cached 

PID 

USER 

PR 

NI 

VIRT 

RES 

SHR 

S 

%CPU 

%MEM 

TIME+ 

COMMAND 

37490 

randyg 

20 

0 

90828 

14m 

5220 

S 

3.0 

0.1 

0: 16.89 

xllvnc 

374*>8 

randyg 

20 

0 

142m 

38m 

19m 

S 

2.3 

0.2 

0  :  1  4 . 4  *> 

Xvfb 

1 

root 

20 

0 

19364 

960 

740 

S 

0.0 

0.0 

0:02.51 

init 

2 

root 

20 

0 

0 

0 

0 

S 

0.0 

0.0 

0:00.01 

kthreadd 

3 

root 

RT 

0 

0 

0 

0 

S 

0.0 

0.0 

0:02.70 

migration/0 

4 

root 

20 

0 

0 

0 

0 

S 

0.0 

0.0 

0:01.40 

ksoftirqd/0 

5 

root 

RT 

0 

0 

0 

0 

S 

0.0 

0.0 

0:00.00 

stopper/0 

6 

root 

RT 

0 

0 

0 

0 

S 

0.0 

0.0 

0:00.50 

watchdog/0 

7 

root 

RT 

0 

0 

0 

0 

S 

0.0 

0.0 

0:03. 16 

migrat ion/ 1 

8 

root 

RT 

0 

0 

0 

0 

S 

0.0 

0.0 

0:00.00 

stopper/ 1 

9 

root 

20 

0 

0 

0 

0 

S 

0.0 

0.0 

0:01.90 

ksoftirqd/1 

10 

root 

RT 

0 

0 

0 

0 

S 

0.0 

0.0 

0:00.46 

watchdog/ 1 

11 

root 

RT 

0 

0 

0 

0 

S 

0.0 

0.0 

0:00.84 

migration/2 

12 

root 

RT 

0 

0 

0 

0 

S 

0.0 

0.0 

0:00.00 

stopper/2 

13 

root 

20 

0 

0 

0 

0 

S 

0.0 

0.0 

0:00.25 

ksof t irqd/2 

14 

root 

RT 

0 

0 

0 

0 

S 

0.0 

0.0 

0:00.42 

watchdog/2 

15 

root 

RT 

0 

0 

0 

0 

S 

0.0 

0.0 

0:00.17 

migrat ion/ 3 

|  [ randyg@pvO 1  - ] $ 

_ 

_ 

N/A  Geometry  Database  :  SMLIB  |  Mesh  Database  :  Create  |  Attribution  Database  :  Create 
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Portal  for  HPC  Developers 


fSI 

High  Definition  KTerm 

a 

JCTerm 

* 

MATLAB 

Firefox 

l 

□ 

Google  Eortfi 

IS 

j  NASA  World  (Wind 

|  Eclipse  IDE 

n 

Mote  Studio 

& 

SoapUl 

H  Y-&S 

JMS  UDOP  Demo  Serve' 

1 

J 

JMS  UDOP 

Ijedit 

"  gedif 

0 

f  GNU  Emocs 

Git  GUI 

% 

IDL  Dev  En  vironment 

Total  View 


Integrated  Development  Environments 

Editors 

Debuggers 

Configuration 
management 

File  manager 

—  Transfers  to/from  client  machine 

—  Permission  editing 

Command  line 
Specialized  HPC  Workflows 
Visualization 


Matlab  running 
through  browser 
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upyter  Notebooks  on  HPC  Porta 


MODERNIZATION  PROGRAM 


Open  source,  interactive  data  science  and  scientific  computing 
platform  (web-based)  supporting  over  40  programming  languages 


J U  py  ter  Lowiz  [Xfferertia!  Equators  . 


e 

PS1»sr  3  O 


jupyter  wetaonwtoP 

(*•£/**•*  tmmi  Call 

r  «  *  »  i 

C jupyter 

Welcome  to  the 


Exploring  the  Lorenz  System 

I*,  tu  Ndrinck  m  axpona  taU'r:  r, liter)  <*  alt  Mill  ma 
i  it 

r»(u-y-K 

t  m  -fit  *  gf 

Th*  «  etm  of  hcctufcMi  !»•*•  K  nsn  •» m>  *o  jalkrw.  II  ■  trgi  o' 

anrf*<  bdir.K’i  u  It*  prfitn  i*V  fi.fi]  urn  mat  heupru  wat  *«•  knswn  aa  m*o 
ia,Kn«  Tit*  AML  eng  r*(<y  cmM:|«k  u  a  arpMu  Tut* MTatlrwa  TKda  Arr 


iJ1* 


0enl«rw9MMt 


Run  kot#  Python  i 


A  M  Mer*  «or  uang  *1# 
l  |  |>  taatplea.lb  U'.lM 


The  Jupyter  Notebook 


The  Jupyter  Notebook  is  a  web  application  that  allows  you  to  create 
and  share  documents  that  contain  live  code,  equations, 
visualizations  and  explanatory  text.  Uses  include:  data  cleaning  and 
transformation,  numerical  simulation,  statistical  modeling,  machine 
learning  and  much  more. 


Language  of  choice  Share  notebooks 


Interactive  widgets  Big  data  integration 


Focus  is  On  Data  Analytics  &  Reproducible  Workflows  for  R&D 
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Portal  Platform  Enables  Integrated  M&S  hec 

MODERNIZATION  PROGRAM 


iiyn 


Advanced  Research  •  Collaboration  •  Application 

Development  Environment 


News 

Monday  2013-09-02: 

Good  news  arcade  te  touted  n  re  ^lraJMS  Newsletter! 
Tuesday  2013-07-02: 


The  JMS  ARCADE  rss  oeen  installed  on  re  new  Portal  Production 
server  Aeoilcatton  auaitaoie  include 


Woncftow  Guilder 

virtual  Aooiicaoon  development  tools 
File  Manager 


Friday  2013-00-28: 


The  JMS  ARCADE  team  ras  suocessljir/  me*  a  major  milestone  This 
milestone  enoompasses  a  treeze  or  all  current  capaoiiities  rat  win  oe 
release  at  re  end  or  jufyttmerrame  During  fie  neat  mom .  re 
development  and  aualRy  assuanoe  teams  will  pertorm  a  Dug  turndown 


Web  access  to  development 
tools  and  resources 


Development  Tools 


Software  Development 
Toolkit 


Virtual  Development 
Environment 


Testing  Tools 


Workflow  Tool 


UDOP 


Automated  web-service 
generation  from  executables 

End-to-end  performance 
testing  in  user  sandbox 


MATLAB 


Utilities 


Xterm 


File  Manager 


Marketplace 
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Service  Directory 


Statistics 


Q. 


Collaboration  Center 


Collaboration  and  market 
survey  tools  and  resources 


Portal  Supports  Technology  Integration  Bee 
into  Acquisition:  e.g.,  ARCADE 


Application 

developers 


Developers  have  access 
to  relevant  scenarios, 
software  tools  and 
building  block  services 


Application 
development 

Application 

development 

Developer 

Facilities 


Portal  App 
Dev’l  Env 


Program 
Review 


Allows  Program  to 
focus  on  high 
pay-off  services  for 
transition 


Common  RDT&E 
environment  with 
benchmarks  for  easy, 
consistent  evaluation 


Operations 


Developer  Test 


Integrated  Test  Operational  Test 
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Example:  Custom  Workflow  Tool  for 
Trade-Space  Exploration  and  Analysis 


MODERNIZATION  PROGRAM 


Output  Parameters: 

•  tagged_obs  -  observations  which  correlated  to  catalog 

•  untagged_obs  -  observations  which  did  not  correlate  to  catalog. 
UCTs 


C2  Scheduler  Configuration 

Schedule  when  a  services  is  called  within  the  current  scenario 
time  frame 

Simple  Repeating  Schedule 

Schedule  at  whether  a  service  will  run  at  a  given  time  step 
during  the  simulation.  Example:  1  ->  Every  Time  Step;  2  -> 
Every  Other  Time  Step,  etc 

1 


Reporting  Schedule 

Specify  when  a  service  reports  its  data  after  the  service 
function  is  initiated.  This  value  is  also  in  terms  of  time  steps 
Example:  1  ->  One  time  step  after  the  service  was  initiaed;  2 
->  Two  time  steps  after  the  service  was  initiated 

0 


User  can  select 
services  based 
upon  group 
permissions 

—  Group 

permissions  also 
used  to  protect 
intellectual 
property 

Different 
combinations  of 
capabilities  can 
be  tested  to 
determine  best 
approach 


Page- 15 


DOD 


Key  “Take  Aways”...  HPC  Portal: 


MODERNIZATION  PROGRAM 


•  Provides  Modern/Productive  Web-Based  Workflow 

•  Demolishes  Entry  Barriers  to  DOD  Supercomputing 

•  Enables  3rd  Party  Developers  &  Innovative  Applications 

•  Supports  a  Modern  HPC  Ecosystem:  Portal  as  Platform  for 
Innovative  Solutions 


Enables  Collaboration,  Advanced  Work  Flows  &  Acquisition 
Engineering 


Questions? 
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Exceptional  service  in  the  national  interest 


®  Sandia 
National 
Laboratories 


mm  % j 
msa&r 


COMPSIM 

LIKE  IT  REALLY  HAPPENS 


Multi-Disciplinary  Integration  of 
ModSim  for  Navy  Applications 


ENERGY 


/m  m  .w 


Greg  Bunting,  Garth  Reese 

gbuntin@sandia.gov  505-845-9708 

Sandia  National  Laboratories  is  a  multi-mission  laboratory  managed  and  operated  by  Sandia  Corporation,  a  wholly  owned  subsidiary  of  Lockheed  Martin 
Corporation,  for  the  U.S.  Department  of  Energy’s  National  Nuclear  Security  Administration  under  contract  DE-AC04-94AL85000.  SAND  NO.  201 1  -XXXXP 


System  Integration  -  Credible  Solution 


Sandia 

National 

Laboratories 


Our  mission  statement . 

Develop  and  deliver  engineering-mechanics 
simulation  applications  &  expertise  for  credible 
National  Security  decision  making. 


Reduce 
Global 
Chemical 
&  Biological 
Dangers 


Global 
Nuclear 
Assurance  & 
Security 


Secure  &  National 

Sustainable  Security  Space 
Energy  Future  Innovations 


Synergistic 

Defense 

Products 


Cyberspace 


COMPSIM 

LIKE  IT  REALLY  HAPPENS 


What  we  offer 

SIERRA  offers  a  wide  range  of  simulation  capabilities 


Sandia 

National 

Laboratories 


Solid  mechanics 
Structural  dynamics 
Acoustics 
Thermal  analysis 
Fluid  dynamics 
Aerodynamics 


COMPSIM 

LIKE  IT  REALLY  HAPPENS 


■/s}Pk:  — 


All  built  on  common  infrastructure 

Sierra  also  couples  with  other  Sandia  tools 

■  Pre  and  post  processing 
(Cubit,  Paraview,  SAW) 

■  Design  and  optimization  (Dakota) 

■  Other  computational  simulation 
capabilities  (CTH,  Alegra,  ITS) 


Distinguishing  strengths  are 

■  Robustness:  production  code  (SQE) 

■  Performance:  parallel  scalability, 
focus  on  NGP 

■  Credible:  V&V,  UQ,  QMU 

■  Multi-scale  and  multi-physics 

■  Access  controlled  code  for  support 
of  National  Security  Mission 
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Our  customers 

Nuclear  Weapons  Program  &  Analysts 

NW  Program  is  the  principal  driver  for  Sandia's 
Computational  Simulation  efforts 


Sandia 

National 

Laboratories 


Delivery 


Separation 

shock/ 

Aerodynamic 

Heating 


Assured  Safety  and  Security 


Survivability 


Staging 
shock 

Random 
vibration 


Mechanical  Insult  Thermal  Insult 


Electromagnetic 

Insult 


Assured  Performance 
&  Manufacturing 


SNL  Engineering  Codes  are  positioned  to  support  the 
engineering  needs  of  the  complex 


Security 

Components 


Safe  & 
Secure 
Transport 
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Navy  Enhanced  Sierra  Mechanics  (NESM) 
Acoustics 


Sandia 

National 

Laboratories 


COMPSIM 

STRUCTURAL  DYNAMICS 


■  NESM  Capability  for  transient  acoustic  loading 

■  Acoustic  approximation  of  UNDEX  loading 

■  Scattering  (split-field)  formulation  to  allow  for  easy 
specification  of  sources 

■  Various  sources:  plane/spherical  step  wave, 
spherically  spreading  source,  Hicks  Bubble. 

■  Ellipsoidal  infinite  elements  for  far-field  boundary 
condition 

■  Allows  large  aspect  ratio  ellipsoids  for  slender  structures 

■  Parallel  and  scalable 


Overview  -  NEMO 


Navy  Enhanced  Sierra  Mechanics 
(NESM) 

•  Massively  Parallel,  Enhanced,  Physics  Based  M&S  Suite 
For  Prediction  Of  Ship  Shock  Response  &  Damage  Due 
To  Weapon  Engagements 

•  Modern  Software  Engineering  Designed  For  Evolution 

•  Developed  To  Address  Validation  Of  The  Integrated  Ship 
System  Shock  Hardness  IAW  OPNAVINST  9072. 2AAs 
Well  As  Live  Fire  Test  &  Evaluation  (LFT&E)  Needs 

•  Leverages  DOE-ASC  Investment  In  Sierra  Mechanics 

•  Leverages  ONR  Investment  In  The  Implosion  Program 


-  Model  Data  -  Test  Data 


Sandia 

National 

Laboratories 


Emphasis  on  Validation  for  Both  Shock  Response 
&  Ship  Damage  Compared  to  Physical  Testing 


Time  (m| 


Compsim  Organization 


1)  Organized  into  several  SCRUM-Teams,  each  developing  and 
support  a  set  or  products 

1)  Structural  Dynamics  (Linear) 

2)  Solid  Mechanics  (Nonlinear) 

3)  Thermal  Fluids 

4)  Toolkit 

5)  Meshing 

6)  Dev  Ops 

7)  Topology  Optimization 

8)  Verification  &  Validation 


COMPSIM 

LIKE  IT  REALLY  HAPPENS 


Sandia 

National 

Laboratories 


Computational  Structural  Dynamics 

Structural  Dynamics  -  Linear,  static,  implicit  dynamic  &  modal  response 


Sandia 

National 

Laboratories 


Shared  mechanics  capabilities 

•  small  deformations,  small-strain  linear  material  behavior 

•  solid  &  structural  elements,  constraint  elements 

•  transient-modal-modal  transient  solution  switching,  multi-sequence  analyses 

•  non-linear  pre-load  transfer  from  Sierra/SM 

Time  domain,  statics  &  transients 

•  parallel  scalable  domain  decomposition  solver  with  many  constraints 

•  joint  models  with  dissipation 

•  material  property  inversion 

•  stochastic  material  (elastic)  properties 


COMPSIM 

STRUCTURAL  DYNAMICS 


shock  response 
Sierra/SM  preloads 


acoustic  field  modeling 


Frequency  domain 

•  Helmholtz  solver,  performance 

Acoustics  -  linear 

•  absorbing  boundaries 

•  acoustic  pressure  source  inversion 

•  monolithic  coupling  with  structural  response 


Capabilities  Applicable  to  DoD  Needs 


Sandia 

National 

Laboratories 


Full  Support  for  Structural  Dynamics 

■  Full  element  library,  materials. 

■  Modal,  Transient  Dynamics,  Frequency 
Response.  Superelements. 

■  SRS,  random  vibration 

■  Quadratic  Eigen  Value  Analysis 

■  Geometric  and  joint-type  nonlinearities 

Full  Support  for  Acoustics  and  Structural 
Acoustics 

■  Mesh  tying,  infinite  elements,  PML,  mild 
nonlinearity 

■  QEV,  Transient,  Frequency  Domain 

■  Inverse  Methods  Capability 

■  Coupled  Physics 

■  Fluids:  nemo,  aero  and  sigma 

■  Thermal  (unidirection):  fuego 

■  Nonlinear  Mechanics 


COMPSIM 

STRUCTURAL  DYNAMICS 


®Sandia 
National 
Laborato 

Full  Support  tor  Structural  Dynamics 


•  Modal,  modal  superposition 

•  Frf 

•  Transient  Dynamics 

•  Superelements 


Specialized  joint 
modeling 


Computational  Solid  Mechanics 


COMPSIM 

SOLID  MECHANICS 

Solid  Mechanics  -  Quasi-static,  implicit  &  explicit  transient  dynamic  response 


Sandia 

National 

Laboratories 


Shared  capabilities 

•  large  deformations,  large-strain  nonlinear  material  behavior 

•  implicit-explicit  solution  switching,  multi-sequence  analyses 

•  continuum  &  structural  finite  elements,  particle  methods 

•  parallel  scalable  accurate  frictional  contact 

•  common  &  unique  material  models:  50+ 

•  geometric  and  temporal  multi-scale  methods 

Implicit  Solid  Mechanics 

•  coupled  thermal-mechanical  modeling,  with  failure 

•  preloads 

•  encapsulation  &  cure,  incompressible  material  behavior 


Implicit+explicit  switching 


pressure  &  temperature  loading 
snap-thru  &  disassembly 


mMsm 


2D  XFEM  Fracture  Simulation 


Explicit  Solid  Mechanics 

•  energy-dependent  material  models 

•  fracture  &  failure  modeling  (cohesive  zones,  XFEM,  remeshing) 

•  empirical  blast  pressure  loads  (CONWEP) 

•  coupled  to  CTH  shock-hydro,  Alegra  EM 


Sierra/SM  Capabilities 

Recent  developments 

■  New  XFEM  fracture  and  fragmentation  capabilities 

■  Now  production-izing  3D  XFEM  capabilities  (2D  in  place) 


Sandia 

National 

Laboratories 


COMPS  I M 

SOLID  MECHANICS 


SM  brittle 
fracture 
modeling 


frag  ID, 
mass 
balance 


Fragment  ID 

Mass 

1 

0.106928 

2 

0.0409208 

3 

0.024103 

4 

0.00205816 

5 

0.553441 

6 

0.0326549 

7 

0.144147 

8 

0.749031 

9 

1.24167 

10 

0.382143 

11 

0.335603 

total  mass 

3.6127 

Fragment  ID 

Mass 

461 

0.00826664 

462 

0.00932047 

463 

0.0140141 

464 

0.0059543 

465 

0.00110272 

466 

0.00673505 

467 

0.0138907 

468 

0.0111858 

total  mass 

3.6127 
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Sierra/SM  Capabilities 

Recent  developments 

•  SM  preload  effects  in  SD 


Sandia 

National 

Laboratories 


COMPS  I M 

SOLID  MECHANICS 


■  Improve  accuracy  of  SD  direct  transient  or  modal  analyses  by  including  the  MPCs  (thru 
file)  generated  from  an  SM  preload 


SM  preload 


SD  modal 


Mode  1 


Mode  2 


Mode  3 


Sierra/SM  Capabilities 

Recent  developments 


Sandia 

National 

Laboratories 


COMPSIM 

SOLID  MECHANICS 

•  Large  deformation  remeshing/remapping  in  SM 

Tensor  preserving  mapping 


SM  material 

parameter 

calibration 

Global 

L2-projection 

transfer 


w/  adaptive  remeshing  displacement  no  remeshing 


SQE  Practices -Test  Driven 
Development  (TDD) 


Develop  Scalable,  Maintainable 
Software 


1.  Write  a  failing  test 

■  Known  Solution 

2.  Make  Test  Pass 

■  Smallest  amount  of  code 
possible 

3.  Refactor 

■  Improve  code  quality 


A 

Fail 

J 

TDD 


SQE  Practices  -  Scrum  /  Agile 


Sandia 

National 

Laboratories 


■  React  to  changing 
requirements  to  meet 
customer  needs 


Sync  Release/Sprint 


Requirements 

■  Coordinate  effort. 

■  Allow  rapid  testing 
of  features. 

■  Avoid  unnecessary 
cost. 


SNL 

Release 


Approach 

■  Use  the  same  Agile 
sprint  boundary. 

■  Sync  code-base  at 
end  of  sprint. 

■  Adjust  to  use  the 
same  release  cycle 

■  Communications  and 
data  transfer 
throughout. 


The  Key  is  a 
collaborative, 

partnership  relationship. 


Release 


W  1 

W  2 

W  3 

W  4 

W  5 

W  6 

W  7 

W  8 

W  9 

W  10 

W  11 

W  12 

W  13 

W  14 

W  15 

W  16 

W  17 

W  18 

W  19 

W  20 

W  21 

W  22 

W  23 

W  24 

W  25 

W  26 

W  27 
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fir 


W  1 

W  2 

W  3 

W  4 

W  5 

W  6 

W  7 

W  8 

W  9 

W  10 

W  11 

W  12 

W  13 

W  14 

W  15 

W  16 

W  17 

W  18 

W  19 

W  20 

W  21 

W  22 

W  23 

W  24 

W  25 

W  26 

W  27 


Flexible  Coupling  Approaches  ® 


Sandia 

National 

Laboratories 


COMPSIM 


There  are  many  coupling  algorithms.  For  example,  iteration 
may  or  may  not  be  required  on  each  advance. 

Focus  on  a  flexible  strategy  that  permits  evaluation  of  these 
algorithms. 

Use  standard  verification  methods  to  ensure  proper  accuracy. 


NEMO 


Coupler  has  unit  tested 
capability  for  each  of  the 
steps  of  the  coupling. 
Surrogate  drivers  permit 


Sierra 


integration  testing 


i 

v 


independent  of  the  region. 


Sierra  DevOps 


Sierra  DevOps  team  enables  development  and  COMPSIM 
distribution  of  the  Sierra  suite  of  applications. 


•  Tools  and  configurations  for: 

>  Build  system 

>  Test  harness 

>  Automated  testing  processes  management 

>  Testing  dashboard 

•  Configuration  &  testing  for  a  wide  range  of 
compilers  and  platforms 

•  Licensing  management,  packaging  tools, 
internal  &  external  delivery 

•  Software  quality  engineering  &  assurance 
testing  (coverage,  memory,  static  analysis) 


Update 

Build 

Test 

Site 

Build  Name 

Files 

Error 

Warn 

Not 

Run 

Fail  V 

Pass 

Build  Time  V 

Labels 

ascic112 

Linux-intel-1 7.0.1 -debug  Q 

6 

0 

0, 

° 

7657;,* 

Jan  23,  2017-17:04  MST 

(6 

labels) 

ascicl  1 1 

Linux-gcc-4.9.3-debug  Q 

6 

0 

0 

0 

IS., 

7697  *2 

Jan  23,  2017-17:02  MST 

(6 

labels) 

ascic126 

Linux-intel-1 7.0.1 -release 

6 

0 

0 

7671  *4 

Jan  23, 2017-  17:03  MST 

(6 

IqKaIo\ 

„  ..  Locations  |  Employee  Locator 

Sandia 

|  National  Search  * 

Laboratories  About  Sandla  i  Missions  ;  Research  ;  News  ;  Careers  j  Working  with  Sandia  i 


Sierra 

Home 


Licensing 

Support 


Plato 


Home 

Licensing 

Support 


Licensee  Links  Below 


>  Downloads 


Sierra 

Sierra  is  Sandia's  engineering  mechanics 
simulation  code  suite.  This  suite  includes 
coupled  simulation  capabilities  for  thermal, 
fluid,  aerodynamics,  solid  mechanics  and 
structural  dynamics.  These  simulation 
capabilities  are  used  to  predict  the 
performance  of  a  system  in  normal  operation 
as  well  as  the  response  of  a  system  in 
abnormal  environments,  such  as  a  crash  or 
fire. 


>  Account  Information 

>  Change  Password 


•  Build,  installation,  and  execution  support 

•  Management  of  software  component  &  library 
integration  and  coupling 

•  Release  branch  creation,  testing,  and  maintenance 


Create  Create  Distribute 

4.42  4.42.1  4.42.1 


Y  Y  » 


4.41.8  4.43.1  4.43.2 


Lead  up  Fix  up  Finalize 
{<=  a  week) 
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Integration  -  Verification  Tests 
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Laboratories 


■  Small  verification  tests  are 
performed  at  Sandia  and 
Document 

■  Verification  tests  are  run 
before  every  sprint  and  full 
release 

■  Verified  and  serial  and  parallel 

■  Verification  document  is  built 
from  passing  tests 


Navy  also  verifies  capability 


Integration  -  Surrogates 


Sandia 

National 

Laboratories 


Mock  executables  demonstrating  Sierra  and  Nemo  were 
created  to  facilitate  development  efforts 

■  Surrogates  run  as  executables,  but  with  empty  data  structures 
and  without  solves 

■  Allow  separation  between  "coupling"  error,  and  "physics" 
errors 


////////////////// 


Verification:  Id  acoustic  piston 


Acoustic 

fluid 


Goal:  test  loosely  coupled 
algorithms  to  assess  temporal 
accuracy 


Structure  displacement 

us(t)  =  e~dt  (a  cos  out  +  b  sin  cut)  +  v(t  —  0) 


Fluid  solution 

Va{t)  =  Us(t  ~  x/ca)H(t  ~  X/Ca) 

Pa(t )  =Poo  +  PaCaVa(t) 


10 

E 


o 

LU 


Displ  Error  (L-Inf) 
■— ■  Displ  Error  (LI) 
Vel  Error  (L-Inf) 
■— ■  Vel  Error  (LI) 

Accel  Error  (L-Inf) 
■— ■  Accel  Error  (LI) 


10-5 


Timestep 


10-4 


10'3 
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User  Support  Model 
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Requirements 

■  Avoid  overload  of 
developers. 

■  Provide  Support  as 
near  customer  as 
possible. 

■  Build  a  sustainable 
system. 


Approach 

■  First  Line  Support  at  NSWC/CD. 

■  CD  forwards  triaged  issues  to  SNL 
development. 

■  Support  tickets  are  maintained 
and  tracked  at  relevant  sites. 


Applications 


Sandia 

National 

Laboratories 
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Questions? 


20th  Annual 

NDIA  Systems  Engineering  Conference 

Springfield,  Virginia 
October  23-26,  2017 


Integrating  DoD  Explosives  Safety  Tenets  and  Requirements 
Into  Acquisition  and  Infrastructure  Planning 


Thierry  Chiapello 

Executive  Director 

Department  of  Defense  Explosives  Safety  Board 


The  DoD  Explosives  Safety  Board  (DDESB) 


Major  Functions 

Develop  and  maintain  the  DoD  Explosives 
Safety  Program 

Support  Combatant  Commanders  Mission 
where  DoD  Munitions  are  involved 


ORIGIN:  Established  in  1 928  by  Congress  after  a 


Support  Multinational  Organizations  and 
Operations  (NATO,  UN,  and  State  Dept) 

Support  Joint  Staff  Assessments 

Develop  and  maintain  DoD  Explosives  Safety 
Policy  and  Regulations 


major  disaster  at  the  Naval  Ammunition  Depot,  Lake 
Denmark,  New  Jersey  in  1926.  The  accident  virtually 
destroyed  the  depot,  causing  heavy  damage  to  adjacent 
Picatinny  Arsenal  and  the  surrounding  communities, 
killing  21  people,  and  seriously  injuring  53  others. 

Strategic  Stakeholders 


Evaluate  Explosives  Safety  Programs 
Perform  R&D 


Organization  -27 


Policy 


22  Civilians 
1  Contractor 
4  Military 


Oversight 


t  \ 

Advocacy 


Secretary  of  Defense  (USD  -  Policy  (P), 
Acquisition,  Technology  &  Logistics  (AT&L), 
ASD(Energy,  Installations  &  Environment) 
(EI&E),  and  International  Programs 

Chairman  of  the  Joint  Chiefs  of  Staff  (Joint 
Staff  J2/J3/J4/J5/J7) 

Combatant  Commanders 

Military  Services  (Army,  Navy,  Air  Force, 
Marine  Corps) 

NATO  (Acquisition  -  Munitions  Safety  AC/326, 
Logistics  AC/305,  SHAPE) 

DoD  Support  Agencies 
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DDESB  Key  Functions 


Charter:  Preclude  &  Prevent ... 

DDESB,  a  statutorily  established  engineering  organization,  is 
responsible  to: 

>  Perform  engineering  tests,  modeling,  and  analyses  to  establish  physics- 
based  explosives  safety  criteria 

>  Oversight  of  Services/ Agencies  Explosives  Safety  Management  (ESM) 
Program 


DDESB  Analyses  -  Data  &  Observations 


•  DDESB  has  observed  tendencies  that  planning  between  the 
acquisition  and  infrastructure  planning  communities  within  the 
Department  could  be  enhanced 

>  Some  system  fieldings  of  the  Department’s  weapon  systems  occurred 
with  infrastructure  deficiencies  resulting  in  sub-optimal  support  for 
operating  forces 
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Examples  of  Sub-Optimal  Planning 

•  P-8  Poseidon 

>  Larger,  heavier  platforms 
damaged  runways  driving 
repairs  and  unanticipated 
construction  and  modification 
of  hangars 


•  Virginia  Class  SSNs 

>Block  V  variant  driving  many 
unanticipated  waterfront 
MILCONs 


Photo  Source: 

http://www.navy.miI/management/photodb/photos/1 60801  -O-NOI 01  -1 1 0.JPG 
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Examples  of  Sub-Optimal  Planning 


•  HIMARS 

>ASP  magazine  doors  could  not 
accommodate  the  width  of 
the  HIMARS  pallet. 


Photo  source: 

https://media.defense.gov/201 7/Jun/1 2/2001 76081 0/-1/-1/0/1 70609-M-YF952-01 6.JPG 
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Examples  of  Sub-Optimal  Planning 


•  Picatinny  Explosives  Research  and  Development 
Loading  Facility 

>  Lack  of  early  design  review  and  approval  resulted  in  significant 
reduction  of  amounts  of  explosives  allowed  in  facility 

■  Desired  HD  1.1  NEW  limit  =  2,410 

■  Approved  HD  1.1  NEW  =  160-lbs 
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Actions  Taken 


•  DDESB  established  a  Working  Group  (WG)  to  determine  if 
gaps  existed: 

>  WG  consisted  of  Services  and  DDESB  representatives 

>  WG  explored  existing  processes  for  gaps  and  best  process  techniques 
being  employed 

>  WG  process  explorations  included: 

■  Pre-production  and  production  safety  oversight  of  munitions  and  explosives 

■  Integration  of  acquisition,  logistics,  and  facilities  and  infrastructure  planning  for 
newly  acquired  systems 

•  WG  identified  pertinent  gaps 

>  Where  gaps  were  identified,  options  to  close  the  gaps  was  explored 

>  Propose  recommendations  to  solve  the  deficiencies 
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Findings 


•  Gaps  have  been  identified  in  the  integration  of  planning  between: 

>The  ‘acquisition’  and  ‘logistics’  communities  and 

>The  ‘facilities  and  infrastructure’  planning  community 

•  Policy/guidance  gaps  locations 

>  Defense  Acquisition  System  Procedures: 

■  DoDI  5000.02,  Operation  of  the  Defense  Acquisition  System,  paragraph  5. 
Procedures 

♦  TMMR 

♦  E&MD 

>  Defense  Acquisition  System  Life  Cycle  Sustainment  Process: 

■  DoDI  5000.02,  Operation  of  the  Defense  Acquisition  System,  Enclosure  6,  Life 
Cycle  Sustainment,  paragraph  2.  Sustainment  Across  the  Life  Cycle 

>  Real  Property  Policy: 

■  DoDD  4165.06,  Real  Property,  paragraph  4,  Policy 

■  DoDI  4165.70,  Real  Property  Management,  paragraph  5,  Responsibilities 

•  Recommended  changes  entail  minimal  disruption  or  cost. 

>  One  Service  currently  employs  an  integrated  process  that  meets  the 


recommended  policy 
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On-Going  Actions 


•  Draft  policy  language  to  close  gaps  has  been  drafted: 

>  Defense  Acquisition  System  Procedures: 

■  DoDI  5000.02,  Operation  of  the  Defense  Acquisition  System,  paragraph  5. 
Procedures 

■  DoDI  5000.02,  Operation  of  the  Defense  Acquisition  System,  Enclosure  6,  Life 
Cycle  Sustainment,  paragraph  2.  Sustainment  Across  the  Life  Cycle 

>  Real  Property  Policy: 

■  DoDD  4165.06,  Real  Property,  paragraph  4,  Policy 

■  DoDI  4165.70,  Real  Property  Management,  paragraph  5,  Responsibilities 

•  Formulate  impact  to  stakeholders 
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Way  Ahead 


•  Brief  leadership  of  detailed  recommendations  and  plan  to  close 
the  identified  gaps 

•  Request  concurrence  with  recommended  policy  enhancements 
to  ‘acquisition’  and  ‘real  property  (infrastructure)’  issuances 

•  Integrate  recommended  issuance  changes  into  next  issuance 
revision 
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HPCMP  CREATE™-Genesis  CFD 


Jim  Forsythe,  Ph.D.,  Quality  Assurance 

July  20,  2017 

Distribution  Statement  A.  Approved  for  public  release:  distribution  unlimited 


Overview 


Q  Genesis  CFD 


e  Sample  Curriculum 


0  Examples 

®  Supersonic  Airfoil 
•  Transonic  Wing 


Distribution  Statement  A. 
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Genesis-CFD  Components/Capabilities 


•  Single  Mesh  Unstructured  Solver 
®  Euler/Laminar/RANS/DES 
®  Ideal  Gas 

«  Limited  cores  per  job  (128-256) 

9  Motion 

a  Prescribed  (including  arbitrary) 

®  6-DOF  without  constraints 

9  Structures 

®  Modal  solver 

9  Plugins  useable,  but  without  SDK  to 
develop 


•  Propulsion 

®  0-D  Linear  engine  model  for  BC’s 
9  Rotating  reference  frame 
®  Sliding  interfaces 

9  Visualization  features 

®  Full  Volume  write  to  Tecplot, 
FieldView,  Ensight 
®  Extracts  for  FieldViewXDB,  Silo, 
Tecplot,  VTK 
9  In-Situ  using  Visit 


Distribution  Statement  A. 
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Sample  Curriculum 


•  Core  courses 

•  Fluids  I  (Incompressible) 

•  Fluids  II  (Compressible) 

®  Experimental  Methods  /  Labs 

9  Electives 

®  Applied  CFD 
®  Propulsion 


Distribution  Statement  A. 
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Sample  Curriculum  -  Fluids 


9  Lectures  -  Use  canned  CFD  solutions  for  illustration  (cylinder,  sphere,  airfoil), 
examples 

®  Langrangian  derivative  terms  on  a  cylinder,  e.g. 

®  Fluid  “particle”  deformation  types  (e.g.  angular/linear  deformation,  rotation,  strain, 
volume  dilitation). 

®  Gradients  (e.g.  pressure) 

®  Steady  vs.  Unsteady 
®  Streamlines,  Streaklines,  Pathlines 


Distribution  Statement  A. 
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Sample  Curriculum  -  Fluids 


9  Lectures  -  Use  canned  CFD  solutions  for  illustration  (cylinder,  sphere,  airfoil), 
examples 

•  Langrangian  derivative  terms  on  a  cylinder,  e.g.  v ^ 

®  Fluid  “particle”  deformation  types  (e.g.  angular/linear  deformation,  rotation,  strain, 
volume  dilitation). 

»  Gradients  (e.g.  pressure) 

®  Steady  vs.  Unsteady 
®  Streamlines,  Streaklines,  Pathlines 
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Sample  Curriculum  -  Fluids 


•  Lectures  -  Use  canned  CFD  solutions  for  illustration  (cylinder,  sphere,  airfoil), 
examples 

®  Langrangian  derivative  terms  on  a  cylinder,  e.g. 

®  Fluid  “particle”  deformation  types  (e.g.  angular/linear  deformation,  rotation,  strain, 
volume  dilitation). 

®  Gradients  (e.g.  pressure) 

®  Steady  vs.  Unsteady 
®  Streamlines,  Streaklines,  Pathlines 

®  Basics  of  CFD  (1-2  lectures) 

®  Show  simple  model  problem  (1-D  linear  convection,  burgers  eqn) 

®  Finite  difference  derivation  from  Taylor  series.  Order  of  accuracy 
®  Explicit  vs.  implicit 

®  When  to  use  CFD  vs.  potential  based  methods 

®  CFD  project  (sphere  at  various  Re) 

®  Simple  geometry  or  provide  meshes 
®  Grid  and/or  timestep  refinement 
®  Comparison  to  experimental  data 


Distribution  Statement  A. 
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Sample  Curriculum  -  Other 


9  Experiment/Lab  course 

9  Subset  of  students  provide  CFD  support 
9  Possible  uses  of  CFD: 

9  Analyze  wind  tunnel  wall  effects 
9  Visualize  the  flow  being  measured 
•  Test  validity  of  CFD 

9  Propulsion 

9  Single  Stage  Analysis  using  rotating  reference  frame  and  sliding  interfaces 
9  Inlet  losses  using  Engine  boundary  condition 

9  Design 

9  CFD  of  final  designs  using  DaVinci 
9  Verify  performance 

9  More  advanced  -  look  at  dynamic  stability  derivatives 


Distribution  Statement  A. 
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Examples  -  Diamond  Airfoil 


®  Description: 

•  Fluids  II 

®  Student  project  or 
as  a  lecture  aid 

9  Slow  oscillating 
pitch  motion  to 
show  effect  of  a 

9  Time: 

9  Meshing:  15 
minutes 

9  Job  Setup:  10 
minutes 

9  Post- processing: 

30  minutes 


Mach  over  Diamond  Airfoil  at  Mach=2.0,  a  =  ±10  deg 


Distribution  Statement  A. 
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Examples  -  Diamond  Airfoil 


®  Description: 

•  Fluids  II 

®  Student  project  or 
as  a  lecture  aid 

9  Slow  oscillating 
pitch  motion  to 
show  effect  of  a 

9  Time: 

9  Meshing:  15 
minutes 

9  Job  Setup:  10 
minutes 

9  Post- processing: 

30  minutes 


Pressure  over  Diamond  Airfoil  at  Mach=2.0,  a  =  ±10 deg 


Distribution  Statement  A. 
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Examples  -  Onera  M6 


9  Description: 

®  Fluids  II 

®  Student  project  or 
as  a  lecture  aid 

®  Shows  transonic 
effects 

9  Time: 

®  Meshing:  Provided 

®  Job  Setup:  10 
minutes 

®  Post-processing: 
30-60  minutes 


Mach  cutting  plane  with  surface  pressure  on  OneraM6  wing 


Distribution  Statement  A. 
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NDIA  #19694:  Software 
Development  Practices  in 
HPCMP-CREATE™  (A  Family  of 
Large-scale,  Physics-based, 
System-of-Systems,  Software 
Development  Projects) 


An  Application  of  Risk-based  Software  Development  Practices 


DOD 


Richard  P  Kendall,  Ph.D.  with 

D.E  Post,  L.G.  Votta,  P.A.  Gibson,  L.A.  Park,  and  S.M.  Sundt 
October  2017 

Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 


MODERNIZATION  PROGRAM 


Risk-based  Software 
Development  Practices  in  CREATE 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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CREATE  Core  Software  Development 
Risks 


MODERNIZATION  PROGRAM 


1 .  Misaligned  requirements  management 

2.  Workflow  management  for  distributed 
teams  across  the  Services 

3.  Team  communications  across  different 
security  enclaves 

4.  Testing 

5.  Product  support  with  limited  resources 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 


Page-3 


Software  Development  Practice  Drivers 


Development  Environment  Indicators 


MODERNIZATION  PROGRAM 


Notional  Home  Ground  Chart  for  CREATE 

after  Boehm,  Using  Risk  to  Balance  Agile  and  Plan  Driven  Methods,  IEEE  Computer  Society,  2003 


The  attributes  of  CREATE  teams  favor  an  Agile  Development 
approach 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Risk  1 :  Misaligned  Requirements 
Management 


Mitigating  Practice.  Express  requirements  as  use-cases  in 
language  that  customers  and  developers  share. 


MODERNIZATION  PROGRAM 


CREATE-Capstone  Foundational1  Required  Capabilities 


MG-06  Use-Cases 


ID 

Description 

MG-00 

Import  Externally  Generated  Geometry  [C 

MG-01 

Create  Parameterized  Geometry 

MG-02 

Support  Dependency-Based  Associativ  ; 

MG-03 

Repair  Externally  Generated  (eg  CAD) « z 

MG-04 

Support  De-featuring  and  Idealization  c  : 

MG-05 

Provide  Robust  Surface  Meshing  Algorit  n 

MG-06 

Provide  Robust  Volume  Meshing  Algow*  in 

MG-07 

Provide  Geometry-based  Mesh  Generc 

MG-08 

Support  Multi-scale  Models 

MG-09 

MG-10 

Support  Legacy  Component  Integratio 
Support  Analysis  Model  Attribution 

MG-11 

Provide  Accurate  and  Scalable  Runtim 

MG-12 

Core  Framework  (Internal  requirements  la 
above) 

MG-06-UC-01 


MG-06-UC-02 


MG-06-UC-03 


MG-06-UC-04 


MG-06-UC-05 


MG-06-UC-06 


MG-06-UC-07 


MG-06-UC-08 


Unstructured  all-tetrahedral  volume  meshing 


Unstructured  hexahedral-dominated  hybrid  meshing 


Boundary  Layer  meshing  with  triangular  wedge  elements  in  the 
viscous  region  transitioning  to  tet.  No  interference  from  other  BL 


MG07-UC04  with  complex  geometries  and  multiple  intersecting 
boundary-layers 


Boundary  layer  meshing  with  hexfprism  in  the  viscous  regin 
transitioning  to  hex/tet 


MG06-UC05  with  complex  geometries  &  multiple  intersections 


Volume  mesh  handing  for  high  order  element  (first  approach) 


Matching  volume  meshes  for  periodic  boundary  condition 


Use-Cases  promote  a  shared  view  of  requirements 


;n  truncation  boundary 


I  with  sources 


Established  in  2008 


MG-06-UC-11 


MG-06-UC-12 


Modeling  and  meshing  for  sliding  planes  for  moving  parts 


Support  for  'strand-meshing'  paradigm 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Risk  1.  Misaligned  Requirements 
Management 


i 

i 

< 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Risk  1.  Misaligned  Requirements  Management 


MODERNIZATION  PROGRAM 


*  Mitigating  Practice:  Bring  Senior  Customer 
Engineers  into  the  planning  cycle  for  new 
processes/workflows 


Example:  CREATE-AV  Planning  Process  for  new  1 
Stakeholder  Processes/workflows _ I 

ISlli ^REATE^^Iann!nglfeam=Sen!orCustome^ng!neere 


Approved  by 
CREATE  AV  Tech 
Advisory  Board 
and  BoD 


1  -  Identify  Key  Acquisition 

Processes  (AP’s) 


4 


7  -  Select  Groups  that  represent  greatest 
impacts  to  acquisition  for  HPC  software 
development  under  CREATE-AV 


6  -  Prioritize  and  Group 
analysis  capabilities 


s\ 


8  -  Build  mechanisms 
for  CREATE-AV 
software  to  impact 
targeted  AP’s 


2  -  Identify  Products  of 
AP’s 


5  -  Identify  HPC  Analysis 
Capabilities  required  to 
improve  AP  WF’s 


3  -  Breakdown  AP 
Workflows  (WF’s) 


4  -  Identify  HPC  Insertion 
Points  into  WF’s 


This  demonstrates  that  the  product  solves  the  customer’s  problem  and  that  it 
can  be  used  in  the  customer’s  workflow 


Distribution  A.  Approved  tor  Public  release;  distribution  is  unlimited. 


Risk  2.  Software  Development 
Workflow  for  Distributed  Teams 


MODERNIZATION  PROGRAM 


after  Boehm,  “Getting  Ready  for  Agile  Methods  with  Care,”  IEEE  Software,  2002 


CREATE:  An  disciplined  agile  approach  with  the  features  of 
Milestone/Risk  and  Agile  Workflow  Management 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 


DOD 


Risk  2.  Software  Development  Workflow  for 
Distributed  Teams 


The  CREATE  Approach — Disciplines  Agile  Development  based  on 
Scrum  with  Risk-based  Milestones 


Release  candidate 


Develop 

Functionality  Integrate 
■ntegoie  N  andTeit 

and  Test 


Develop 
Functionality  2 


Beta  milestone 

Demo 

Release 


Feedback 


Sprint 


integrate  and 

Test 


Develop 
Functionality  \ 


Design  reviews 

"Inception"  Phase 


Next  Annual  Increment 
In  Product  Roadmap 


Our  approach  couples  flexibility  with  accountability 


Figure  after  info@matrix-soft.org 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Risk  2.  Workflow  Management  for 
Distributed  Teams 


•  Mitigating  Practice:  Require  at  least 
one  new  “version”  every  year 


MODERNIZATION  PROGRAM 


Annual  releases  guarantee  meaningful  progress 
during  the  fiscal  year 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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^  _  _  MODERNIZATION  PROGRAM 

Risk  3.  Communications  across  different 
Security  Enclaves 


Mitigating  Practice:  Start  with  an  extended  view  of  the 


PDC  VI TC  Dk/iWi  i/'# 


Ensure  that  Customers  see  the  “whole”  product 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Risk  3.  Communications  across 
different  Security  Enclaves 


enWro'’'77*1^ H 

CR^ 


MODERNIZATION  PROGRAM 


0  HPCMP  create 

Welcome  to  H 


TM 

and  Help 


Select  one  or  more 


Projects  below  lor 


Authorization 


f  r o«TAl 

Hpc  Portal  ,pA) 

Applications  (P 


Air 


Vehicles  (AVI 


Military  air  vehicle 
design  end  analys* 
Kestrel. 


Software 

Helios 


Ground  Vehicle* 

(GV) 

Military  ground 
vehicle  concept 

design  and  analysis- 

sonwere  Ground 
Vehicle  Interface. 


Meshing  a"^) 
/-.oometry 


Geometfy 

platform  for 
geometry  mesh 
generation  and 
attribution  modeling 
Software  Capstone 


rF  Antennas 
(RF) 

RF  antenna  design 

and  integration  '•■nth 
platforms 
Software  SENTRi 


'Ml“~S!f2.ftcto,l without  in“a"all°n 

=r 

rr  Create  servers  on  sep. 


Secure  access  without  the  installation  of  any  software 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Risk  4:  Software  testing 


MODERNIZATION  PROGRAI 


Mitigating  Practice:  Implement  a  testing  program 
compliant  with  National  Research  Council  guidelines 


External 

QA  team  beta  testers 


Quality 

assurance 

tests 

(including  alpha 
tests  of  use  cases 
and  exit  tests) 


Regression  tests 


6  levels  of  testing  in  CREATE  -AV! 


■=> 


Beta  tests 


Not  just  binary  “yes”  or  “no” 
Customer  view  of  testing 
Verifies  satisfaction  of  use- 
cases 


Developers 

Unit 

Integration 
Regression  tests 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Risk  4:  Software  Testing 


MODERNIZATION  PROGRAM 


Mitigating  Practice:  Strive  for  continuous  integration  with 
automated  regression  tests  for  each  commit 


CREATE-RF  Continuous  Integration  Platform 


Discover  problems  before  they  are  hard  to  fix 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Risk  5.  Inadequate 


4r 


CREATE’ 


B  Mitigating  Practice:  Maximize  the  use  of  self-help  and 
^  user  forums  in  the  support  model. 


C 


CREATH 


O  CREATE  Homt 

'rfc---'  <•  ■ v,e'  ’“p4 j 


rtal  createtiPcrnil  Google 

https  P°rtalC  TheN*wVorkT.m«.' 

..  u,  Ma--  ® 


Welcome10  C)*® 


Q  CNN-corn 


☆ 

»  D  Other  boob"**5 

A 


CREAit*'”  - 

CREATE  Air  Vt. 

Feel  free  to  as 

_  jSS*$ rie 

— ‘  gsSSf 


j eratorjd_r_ - 


O'”-""-  •  ^rFATE 

Welcome  to  CREA  i 

. 'ar>3irKV  e,Hel1osDaV,no 

Software  Kes 

^eC-^8ndMeSNn9 

slate  capstone 


p  AND  CONSENT  BANNER 

«v/eRNMENT  NOTICE  ,  , ,  iSG-authonzeO  use 

US° 


Xne  USG  toutine1)  J°un?ertn^lnCe  invC5*93 

limited  taP*"^  enforcement  OB  d  on  m.s »  monltonng. 

H  an,  time.  the  s.orec ion.  #* 1  used  (or  an,  proted  uSG 

Communicaeonsu^^a,  oedsdose  a„d  access  conirds) 

. 

stalls  nfthe  at>ove  co 


Software  ^ 

porta.  APP''««o"^A’ 

HPCMP  Pots' lnrt,a 

pf  Antennas  OW  and  mtegrafot  *t®’ 
Rf  antenna  (Jes'y 
platforms 
Software  St 


»■*«*'**' 


Self-help  scales  as  the  user  base  grows 


Disti 


release;  distribution  is  unlimited. 
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ARMY/USMC 


MODERNIZATION  PROGRAM 


How  Well  Has  this  Worked? 


Over  180  organizations  across  DoD/Gov't,  Industry,  and  Academia 
User  organizations  are  split  roughly  40%  DoD/Gov't,  50%  Industry, 
10%  Academia 

Impacting  ~70  DoD  programs  of  record  and  major  S&T,  T&E,  and 
R&D  efforts  across  the  major  warfare  domains  of  Air,  Sea,  Land,  and 
EM  spectrum  throughout  the  acquisition  cycle 
Constant  positive  growth  of  user  licenses  since  (~7%  growth  in  the 
past  6  months) 


LX(R) 


E-2D 


CREATE  User  Licenses  2012-2017 


UH-60 


CH-47  (ACF 


F-1 5  SA/DB-1 1 0  Strategic  Airlift  CP&A 


%  $  T  3  3  5 

Current  CREATE  Licenses  by  Month 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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NDIA  #19694 


MODERNIZATION  PROGRAM 


Richard  P.  Kendall,  Ph.D. 

Software  Engineering  Consultant 

DoD  High  Performance  Computing  Modernization  Program 
(505)  660-0976 

Richard.p.kendall4.ctr@mail.mil 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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NDIA#19703:  Verification 
and  Validation  in  CREATE 
Multi-Physics  HPC 
Software  Applications 


DOD 


Lawrence  G.  Votta  Ph.D.  with 

K.P.  Kendall,  D.E.  Post,  E.T.  Moyer  and  S.A.  Morton 
October  201 7 

Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 


MODERNIZATION  PROGRAM 


Outline 


•  Introduction 

-  VVUQ 

—  Design-Analyze-Build 

-  Observations 

•  CREATE  Verification  and  Validation  Principles 

•  Verification  Practices 

•  Validation  Practices 

•  Examples 

•  Observations  and  Conclusions 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 


Introduction:  Verification  &  Validation 

The  Modeling  and  Simulation  Ecosystem 


MODERNIZATION  PROGRAM 


Validation 

Prediction 


TRUE,  PHYSICAL 
SYSTEM 


Representation 


f  \ 

f  \ 

COMPUTATIONAL 

MATHEMATICAL 

MODEL 

MODEL 

V _ J 

L  J 

Verification 


Verification,  validation,  and  prediction  as  they  relate  to  the  true,  physical 
system,  the  mathematical  model,  and  the  computational  model.  (Adapted 
from  American  Institute  for  Aeronautics  and  Astronautics.  1998.) 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Introduction:  Verification  &  Validation 

Important  Terms  and  Concepts  - 1 

•  Quantity  of  Interest  (QOI)  -  are  the  output(s)/result(s)  of 
computational  models,  and  are  used  in  the  engineering 
and  study  of  modeled  systems. 

•  Verification  -  how  accurately  a  computer  program 
(“code”)  correctly  solves  the  equations  of  the 
mathematical  model. 

•  Validation  -  the  degree  to  which  a  model  is  an  accurate 
representation  of  the  real  world  from  the  perspective  of 
the  intended  uses  of  the  model. 

•  Uncertainty  Quantification  (UQ)  -  quantifying 
uncertainties  associated  with  model  calculations  of  true, 
physical  QOIs. 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Introduction:  Verification  &  Validation  - 

Important  Terms  and  Concepts  -  2 

•  Community  of  Interest  -  A  community  of  domain 
experts,  computational  users  and  modelers  that 
maintain  detailed  domain  knowledge,  shared 
validation  test  suites,  and  benchmarks  for  problems 
of  interest. 

•  Intended  Use  -  A  computational  model  cannot  “be 
proven”  correct.  Usually  a  community  of  interest 
defines  problems  in  a  domain  and  sets  an 
acceptable  level  of  testing  to  insure  that  the 
computational  model  is  validated.  An  intended  use  is 
defined  by  the  set  of  problems. 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Introduction:  CREATE  Project 

Design  -  Analyze  -  Build 


r 

Concept 

Development 

- \ 

Engineering  Development 

>1 _ J 


/ - \ 

Post  Development 

_ j 


Design Bui  I d-> Test 

Virtual  Environment 

- < - 

Multi-physics  based  performance  analysis 

Build  Final  Product  ->  Physical  Test 


Manufacture 

And 

Sustainment  & 
Modification 


21st  Century  Goal  -  Rapid  and  Agile  Systems  Development 


Potential  for  Large  Potential  for  Large  Productivity  Additional 

Productivity  Gains  Gains  Productivity  Gains 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Introduction: 

Observations 


MODERNIZATION  PROGRAM 


•  “essentially,  all  models  are  wrong,  but  some  are  useful” 
(https://en.wikipedia.org/wiki/Georae  E.  P.  Box) 

•  “Since  it  isn’t  possible  to  prove  that  the  complex  multi¬ 
physics  software  in  the  Computational  Research  and 
Engineering  Acquisition  Tools  and  Environments 
(CREATE)  program  is  mathematically  “correct”,  there’s  a 
risk  that  without  adequate  testing,  it  won’t  be  trusted  to 
provide  accurate  predictions  of  weapon  system 
performance”. 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Core  CREATE  Verification  and 
Validation  Practices  -  Principles 

Align  testing  with  National  Research  Council  best-practices 
for  scientific  software ,  supplemented  and  refined  by  the 
CREATE  staff’s  collective  experience  in  DoD,  DOE,  industry, 
and  academia .  (ISBN  978-0-309-25634-6) 

•  Verification  Principles: 

—  Solution  verification  is  well-defined  only  in  terms  of  specified  QOIs. 

—  The  efficiency  and  effectiveness  of  code  and  solution  verification 
can  often  be  enhanced  by  exploiting  the  hierarchical  composition 
of  codes  and  mathematical  models,  with  verification  performed  first 
on  the  lowest-level  building  blocks,  and  then  on  successively  more 
complex  levels. 

-  The  goal  of  solution  verification  is  to  estimate,  and  control  if 
possible,  the  sources  of  error  in  the  implementation  of  the  models 
for  each  QOI  for  the  problem  at  hand. 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Core  CREATE  Verification  and 
Validation  Practices  -  Principles 

•  Validation  Principles: 

—  A  validation  assessment  is  well-defined  only  in  terms  of  specified 
QOIs  and  the  accuracy  needed  for  the  model’s  intended  use. 

-  A  validation  assessment  provides  information  of  model  accuracy 
only  in  the  domain  of  applicability  “covered”  by  the  physical 
observations  employed  in  the  assessment. 

—  The  efficiency  and  effectiveness  of  validation  and  prediction 
assessments  are  often  improved  by  exploiting  the  hierarchical 
composition  of  computational  and  mathematical  models. 

-  Validation  and  prediction  often  involve  specifying  or  calibrating 
model  parameters. 

-  The  uncertainty  in  the  prediction  of  a  physical  QOI  must  be 
aggregated  from  uncertainties  and  errors  introduced  by  many 
sources,  including  discrepancies. 

-  Validation  assessments  should  consider  the  uncertainties  and 
errors  in  physical  observations  (measured  data). 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 


Core  CREATE  Verification  Practices 

code  and  solution  both  ...” 

1 .  Design  code  with  hierarchical  code  verification  in  mind. 

2.  Develop  a  verification  test  plan. 

3.  Verify  the  code  prior  to  validation. 

4.  Verify  the  code,  as  much  as  is  practical,  and  document 
the  coverage. 

5.  Conduct  hierarchical  testing  (that  is,  unit,  integration, 
system,  and  regression  tests),  and  document  the  results. 
Automate  testing  to  the  greatest  degree  possible. 

6.  Document  the  domain  and  range  of  intended  use  of  the 
code. 

7.  Use  as  many  types  of  verification  tests  as  are  feasible. 

8.  Test  for  software  integrity. 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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Core  CREATE  Validation  Practices 

model  represents  reality  ...” 

9.  Validate  for  the  full  range  of  the  code’s  intended  use. 

10.  Develop  an  archival  database  for  validation. 

1 1.  Validation  should  be  focused  on  the  behavior  and 
accuracy  of  QOIs  associated  with  use-cases. 

12.  When  metrics  are  used  to  assess  the  difference  between 
model  and  experiment,  they  should  only  measure  the 
mismatch  between  computational  and  experimental 
results. 

13.  Develop  validation  project  plans,  review  them  with 
independent  experts  and  users,  and  execute  them. 

14.  Formally  assess  the  V&  V  status  and  progress. 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 


Example 

CREATE  AV  Turbulence  Model  Tests 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 


Example 

Floating  Shock  Platform  (FSP)  and  typical  FSP 
underwater  explosion  (UNDEX)  test 


Tine  <s> 

Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 


Observations  and  Conclusions 


MODERNIZATION  PROGRAM 


•  Automate  testing  as  much  as  possible. 

•  As  intended  uses  for  computational  models 
evolve,  so  do  the  V&V  test  case  suites.  There  is  a 
continual  need  for  maintenance  and  evolution  of 
test  cases  and  tools  that  support  automated 
testing. 

•  The  principles,  as  discussed  in  the  NRC,  have  led 
to  a  cost-beneficial  set  of  practices  that  lead  to 
high-quality  supercomputer  software 
applications. 


Distribution  A:  Approved  for  Public  release;  distribution  is  unlimited. 
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DoD  Risk  Management  Deficiencies... 

And  How  to  Fix  Them 


Richard  Sugarman 
Steven  Glazewski 

Air  Force  Institute  of  Technology 

School  of  Systems  and  Logistics 

Department  of  Systems  and 
Software  Engineering  Management 


school  of 

SYSTEMS 

LOGISTICS 


►  education  ►research  ►consultation 


Our  student  inputs... 


Air  Force  Institute  of  technology 


•  Issue  management  is  "daily  normal" 

•  RM  is  centered  on  checking  boxes 

•  Too  much  focus  on  complying  with  reporting 
directives 

•  Measurement  of  activity,  not  achievement 

•  Misplaced  incentives 


Recommendations 


Air  Force  Institute  of  technology 


•  Know  your  organization's  measureable 
objectives 

•  Think  about  tolerance  to  the  uncertainty  that 
matters 

•  Measure  uncertainty  -  ranges  and  confidence... 
not  ordinal  values  or  red/ye  I  low/green 

•  Consider  how  to  get  best  return  on  resource 
investment  to  reduce  uncertainty 


RM  is  about  Decisions... 


I  air  force 


...which  starts  with  knowing 
organizational  objectives! 


Note:  Outputs  =  measureable  objectives 


Recommendation  #1 


l  air  Force  Institute  df  technology 


Know  your  org’s  measureable  objectives 


Inputs 


Outputs 


INPUTS 


PROCESSES 


Sub-Org  A 


*0” 


Sub-Org  B 


‘O” 


‘O” 


OUTPUTS 
- ► 


What  is  Risk? 


Uncertainty  That  Matters 


*  Definition  from  Dr.  David  Hillson,  www.risk-doctor.com 


How  much  RM  do  I  need? 


A 


Air  Force  Institute  of  technology 


CO  O) 

cn  -i 


“O 

o 

o 


o 

o 

o 


Negative  Impact  of  Event 


Likelihood  of  Risk 
Event  Occurring 


Recommendation  #2 


air  Force  Institute  of  technology 


Think  about  tolerance  to  the 
uncertainty  that  matters 


A 


Organizational 

Processes 


Negative  Impact  of  Event 


> 


►  Outputs 


Air  Force  Institute  of  technology 


Which  risk  is  "the  worst"? 
Which  has  the  greatest  uncertainty? 


Consequence 


Likelihood 


air  Force  Institute  of  Technology 


Is  a  risk  rated  "25"  really  2.5  times  worse 

than  a  risk  rated  "10"? 


Consequence 


Likelihood 


NO!  Ordinal  values,  so... 


Consequence 


Air  Force  Institute  of  technology 


Better  ways  to  think  about  uncertainty 


Recommendation  #3  .gklfpTT 

Force  Institute  of  Technology 

Measure  uncertainty  =  ranges  and  confidence 
. .  .not  ordinal  levels  or  red/yellow/green 


NO!!  |  © 
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Consequence 


Consequence  -  Schedule  slip  in  days 


Air  Forge  Institute  df  Technology 


Negative 
Impact  to 
Objective 


Future  chains 

of  potential  - > 

events 


Present 

Time 


•  Accept 

•  Mitigate 

•  Avoid 

•  Transfer 

•  Monitor 

•  Research 


v. 


Y 

Reduce  the  iikeiihood 
of  the  chain 

\ _ 


j 


v_ 


and/ 

or 


Y 

Change  the  timeframe 


Y 

Reduce  the 
Impact 

_ J 


J 


Recommendation  #4 


l  Air  Force:  Institute:  df  technology 


Consider  how  to  get  best  return  on 
resource  investment  to  reduce  uncertainty 


Negative 
Impact  to 
Objective 


Present 

Time 


Future  chains 
of  potential 
events 


V. 


y 


j 


v. 


■y 


j 


Reduce  the  likelihood  and/  Reduce  the 
of  the  chain  or  Impact 

V _ ) 


Y 

Change  the  timeframe 
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"Never  attribute  to  malice  or  stupidity  that 
which  can  be  explained  by  moderately 
rational  individuals  following  incentives  in 
a  complex  system  of  incentives." 


—  Douglas  W.  Hubbard 


Air  Force  Institute  of  technology 


"Never  attribute  to  malice  or  stupidity  that 
which  can  be  explained  by  moderately 
rational  individuals  following  incentives  in 
a  complex  system  of  incentives." 

—  Douglas  W.  Hubbard 


"Earned  Autonomy" 


Recommendations 


Air  Force  Institute  of  technology 


•  Know  your  organization's  measureable 
objectives 

•  Think  about  tolerance  to  the  uncertainty  that 
matters 

•  Measure  uncertainty  -  ranges  and  confidence... 
not  ordinal  values  or  red/ye  I  low/green 

•  Consider  how  to  get  best  return  on  resource 
investment  to  reduce  uncertainty 


Air  Force  Institute  of  Technology 


AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 


Thank  you! 


Richard  Sugarman  Steven  Glazewski 

richard.sugarman@afit.edu  steven.glazewski@afit.edu 

937-255-7777  x3247  937-255-7777  x3230 
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Carder^ck  Division 


“CREATE-SH  IHDE:  Workflow  Process 
Improvements  for  Hydrodynamics 
Characterization  of  Ship  Designs” 


Presented  at  NDIA  Systems  Engineering  Conference 

Wesley  Wilson,  R.  Keawe  Van  Eseltine,  Jun  Li,  and  Joseph  Gorski 

Naval  Surface  Warfare  Center  -  Carderock  Division 

26  October,  2017 


DOD 


Presenter:  Wesley  Wilson,  NSWC  Carderock  Div. 
Computational  Design  &  Analysis  Branch  (871) 
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Introduction 


MODERNIZATION  PROGRAM 


•  Hydrodynamics  is  an  important  enabler  in  defining  a  ship  design 

•  For  new  hull  form  concepts  and  non-conventional  designs 
experience  and  data  are  lacking 

-  NEED  ROBUST  TOOLS! 

-  NEED  EFFICIENT  WORK  FLOW  PROCESSES! 

•  The  use  of  simulation  tools  earlier  in  the  design  cycle  to  help  better 
characterize  the  ship  performance  as  early  as  possible  could  result 
in  significant  cost  savings  by  avoiding  costly  modifications  later  in 
the  design 

-  NEED  IMPROVED  TIME  TO  SOLUTION! 

-  NEED  TO  LOWER  BARRIERS  TO  USER  COMMUNITY! 
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POD 

COMNAVSEA  Memo:  4  Feb  2008  HPC 

MODERNIZATION  PROGRAM 

Functionality  and  Timeliness  Objectives  - 

(Reaffirmed  Oct  2010  by  NAVSEA  Chief  Engineer  for  Naval  Systems 
Engineering 


•  “This  memorandum  establishes  high-level  capability  goals  for  NAVSEA 
design  synthesis  and  analysis  tools  in  order  to  guide  development  efforts 
within  the  Navy  and  for  the  DoD  sponsored  CREATE  ...” 

•  Joint  Capabilities  Integration  &  Development  (JCIDS) 

—  capability  to  generate  and  analyze  hundreds  of  ship  concepts  to  a  rough  order  of 
magnitude  level  within  a  period  of  weeks  or  months” 

•  Concept  Refinement 

—  “...accurately  portray  cost  versus  capability  trade-offs,  including  uncertainty  analysis, 
for  dozens  of  ship  concept  options  within  a  six-month  period  of  performance” 


IHDE  addresses  Concept  Refinement  and  JCIDS  through 
incorporation  in  Rapid  Ship  Design  Environment  (RSDE) 
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IHDE  Description 


MODERNIZATION  PROGRAM 


•  Desktop  application  that  integrates  a  suite  of  hull 
form  analysis  tools  including  visualization 

—  Range  of  accuracy  vs.  computational  expense 

—  Integrated  visualization  capabilities 

•  IHDE  focused  on  Hydrodynamics 

—  Use  by  naval  architects  and  design  agents  in  early  design  stages 

—  Enables  more  complex  analyses  by  Hydro  SMEs  at  all  design  stages 
and  efficient  way  for  SMEs  to  engage  the  design  community 

—  Supports  hydrodynamic  analysis  needs  for  design  space  exploration  and 
other  ship  performance  domains 

•  Rapid  Ship  Design  Environment  (RSDE) 

•  Integrated  Structural  Design  Environment  (ISDE) 

•  IHDE  is  a  workflow  process  environment 

—  Enabler  for  analysis  tools  and  information  exchange  across  domains 

•  Efficiency  improvements  vs.  SME  one-offs 

—  Provides  integration  framework  with  automation 

•  Automated  meshing,  solution  preparation  and  execution 
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Product  Model 


MODERNIZATION  PROGRAM 


•  Leading  Edge  Architecture  for  Prototyping  Systems  (LEAPS) 

—  Geometry  and  Engineering  Math  Library  (GEML)  as  mathematical 
framework  for  representation  of  geometry  and  data 

—  Interoperability  amongst  all  of  the  different  activities  that  rely  on  LEAPS 
product  model  (e.g.,  IHDE,  RSDE,  ASSET) 

—  Common  taxonomy  regarding  ship  geometry  and  characteristic 
information  (denoted  Focus) 

—  Synergy  in  software  development  amongst  all  LEAPS  related  activities 

•  Focus  is  to  improve  exchange  of  product  model  data  between 

design  agents  and  analysis  activities  within  an  integrated 

framework 

—  Maintain  integrity  of  the  data 

—  Information  exchange  across  different  disciplines  in  a  timely  manner 


Significant  investment  over  many  years  into  developing  the  capabilities 
and  infrastructure  of  the  LEAPS  environment  has  been  a  significant 
enabler  for  all  of  the  applications  that  use  the  LEAPS  product  model. 
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LEAPS  Product  Model 


MODERNIZATION  PROGRAM 


LEAPS  Editor  -  [TWR] 


EJB® 


File  Edit  View  Display  Tools  Window  Help 


Editor  Log 

TWR  opened  successfully. 

Thursday,  July  06,  2006  h:13  m:32  s:02 
Database  Opened  :  TWR 


D  Q 

PH  | LDB  | 

B  Database 


e 


^  ^  ^  te" 


[*]:Study 

(from  Ship  System  Study) 


)  Parts 
in  46 

_ersion  46 
— ip  Behaviors 


m 


1..* 


[_g]  Ship  Characteristics 
O  M  5h'P  Components 
El  O  S  sh'P  Geometry 

S  O  ©  Molded  Form  Views 
0..*  El  o  2“  Views  Of  Appendages 

—  r,t-  Breads 

ship_[a:lnstanceNumber]:Concept  houses 


■i  b  ^  VievWbf  Openings 

q  g*ViewJ  oj  Otfter  Major  Structures 
O  Views  Of  Weather  Exposed  Ge 
O  ^  Compartment  Boundaries 


shipRequirements:Concept:PropertyGroup 

(from  Ship  Requirements) 


PropertyGroups  - 
container  for  data 
attribution 


CommonViews  - 
container  for  data  that 
represents  particular 
subset  of 

geometry/irfformation 
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Integrated  Hydrodynamics  Design  Environment  (IHDE) 


DOD 


MODERNIZATION  PROGRAM 


Data  Comparisons 


Seakeeping  Behaviors 


Hoove  <m) 

tHOVTOSITID  H*gr*  "Tft  NM  •  fj.  MfllCMWOM 


RESISTANCE 

POWERING 

MANEUVERING 

LOADS 

SEAKEEPING 

LOCAL 

HPC 


DESIGN  STUDIES 
SHAPE  OPTIMIZATION 


VALIDATION  STUDIES 


HPCMP 


TSD  I  AEGIR  SswMRP|  IMPEST  NavyFOAM 


LAMP 


Problem 
Set  U 


Conditions  Geometry 
DRIVER/GUI 


Automated 
Griddin 


IHDE  Graphical  User  Interface 

ihde  8.0 

File  Edit  Options  Help 

j  8  ^  f* 

Model  Explorer  i9  X  Wave  Pattern  -Aegir  Analysis:  Frigate,  04/19/16, 11:52:35 


MODERNIZATION  PROGRAM 


4  Asset61_RefDB 
4  ®  Focus 

g  DDG  1000 
|S|  DDG  79 
*  |B  Frigate 
0i  Hulls 

4  0  Resistance  Behaviors 

4  0  Aegir  Analysis:  Frigate,  04/19/16, 11:52:35 
Bare  Hull  Drag  Vs  Speed  And  Draft 
Wave  Pattern  Vs  Speed  And  Draft 
C>  0  TSD10  Analysis  :  Frigate  ,  522016,  22224 

>  0  TSD10  Analysis  :  Frigate  Gridl  ,  442017,  82412 
4  0  Seakeeping  Behaviors 

t>  0  SEP96 Analysis:  Frigate,  312017, 153719 
0  0  SEP96  Analysis  of  Frigate  at  09:54:10 

>  0  SMP95 Analysis:  Frigate,  312017, 152958 

>  0  SMP95  Analysis  :  Frigate  ,  442017,  8333 

>  0  SMP95 Analysis:  Frigate,  522016,221729 
t>  0  SMP95  Analysis:  Frigate,  522016,  22832 

^  LHD8 
t>  LPD  17 

p\  Small  Green  Series  64 


[V]  (j/  Information  (2)  [V]  ^  Warnings  (0)  ®  O  Errors  (0)  Q  All  Messages 


Description 


Message  Display 


Type 

2  Q  Information 
1  Information 


Name  Source  Name 

GUIController  FocusGui  IHDEUpdateTo7_0:  status=SUCCESS 

GU (Controller  FocusGui  IHDEUpdateTo7_0:  status=SUCCESS 
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IHDE  Description 

•  Usability  is  important! 

—  Impacts  in  ship  design  require  robust  work 
flow  processes  to  avoid  costly  delays 

•  Automated  analysis  preparation  and 

parallel  execution 

-  Interactive  wizard  pages  used  to  create 
solver  inputs  (reduces  input  errors) 

-  Prepopulated  ship  characteristics  from 
product  model 

-  Remote  Execution  System  (RES)  processes 
analysis  jobs  in  background 

-  Automation  of  complex  inputs  increases 
productivity 

•  Automated  mesh  generation 

-  Access  to  CREATE-MG  Capstone  methods 

—  Improved  time  to  solution 

•  Integrated  visualization  capabilities 


MODERNIZATION  PROGRAM 


Speetfy  TSO  Input  Parar 


TSD  run  directory  |Reasl»ice\AssetS1_RefDB\TSD10_ahip_0000006_011415J  53727 
TSD  Rin  Title:  |TSD10  Analyst*:  Semi  Green  Series  64. 01/14/15. 15:37:27 


Number  of  Hub  1 

Shp  Length  Overal.  *n):  |  134.9999 

Ship  Speed  Range  for  Analysis 

Number  of  Speeds:  |  10 

Mn.  Ship  Speed  .  m/s:|  30867 

Max  Ship  Speed,  m/s:  |  19  223722 

Ship  Waterline  Range  for  Analysis 

No  of  Shp  Waterines:  |  2 

Mn.  Shp  Watertne.  m:  |  4.3976 

Max  Sh*>  Watertne.  m;  |  5.6168 


j  TSD  Control  Paramters 
W  Watertne  ntegral 
I*  Wave  component 
[  r “  Set  Ictef  •  1 

TSD  Output  Options 
(Drag  always  computed) 

C  None 

Row  along  ahtp  watertne 
C  Row  on  ship  hti  surface 
<*  Row  at  mean  free  surface 

C  Flow  wShn  flow  domain 


Extenor  Fli»d  Domain  Constants 
<*  Seawater  C  Freshwater 
Water  Dens*y  fcg/frT3)):  |  1026 

Kinemabc  Viscos*y  ((m'TJ/s):  |  10319e-006 
Gravty  fr/fs'T)):  |  9-807 

Local  Component  Option 
r  Ignore 

C  WniteRud 
c  Double  Body 
r  Infinite  Speed 

Free  Surface  ^  I 

Domain  - ! - 1 

Ship  Characteristics  | 


Number  of  Huls:  1 

Sh*p  Length  Overal.  (m):  |  134  9999 

Ship  Speed  Range  for  Analysis 

Number  of  Speeds:  |  10 

Mn.  Ship  Speed  .  m/s:  |  3.0867 

Max  Ship  Speed,  m/s:  |  19  223722 

Ship  Waterline  Range  for  Analysis 

No  of  She  Waterines  |  2 

Mn  Ship  Waterline,  m:  |  4  3976 

Max  Ship  Wateri*>e.  m:  |  5  6168 
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User  Interactivity 


300 


Height=7.5m  Period=9.7$ 


RoU (deg) 


J  LONGCRESTED,  Heght  -  3.2 
J  LONGCRESTED,  Height  -  3.2 
J  LONGCRESTED,  Height  =  3.2 
J  LONGCRESTH),  Height  -  5, . 
J  LONGCRESTED,  Height  -  S,  . 
J  LONGCRESTED,  Height  =  5, . 
J  LONGCRESTH),  Height  =  7.5  . 
8  U  Shp  Responses 

•  199  Shp  Displacement  Res. 
O  (99  Shp  Velocity  Response 
O  (99  Shp  Acceleration  Resp 
O  Shp  Added  Resistance 
$  p  Motion  Point  Responses 
£  J  Relative  Motion  Point  Res. 
J  LONGCRESTED,  Height  -  7.S 
J  LONGCRESTED,  Height  =  7.5 
J  SHORTCRESTED.  Height  =  3. 
J  SHORTCRESTED,  Height  -  3. 
J  SHORTCRESTED,  Height  =  3. 


Plot  Type 
ffUne 

Rectangiiar  _ 
r  n.0-  ( 

Displacement 

C  Surge  Rol 

C  Sway  C  Pitch 

r  f  Viu. 

Seakeeping  Results  Display  Controls 

Speed  (kts)  |  12-0 

1 _ _ _ _\ 

Plot  Parameters ...  | 

Plot  Preferences  ...  [ 

Screenshot...  | 


Roll  (dag) 

LONGCRESTED.  Haight  =  7.5.  Period  =  9.7,  BRETSCHNEIDER 


1.2&^  6.7952  17.9147,^n745 


' 


p  LONGCRESTED,  Height  =  3.2  * 
P  LONGCRESTED,  Height  =  3.2 
P  LONGCRESTED,  Height  =  3.2 
P  LONGCRESTED,  Height  =  5, . 

P  LONGCRESTED,  Height  =  5, . 

P  LONGCRESTED,  Height  =  5,  . 

P  LONGCRESTED,  Height  =  7.5  _ 
p  Ship  Responses 
•  CJ9  Ship  Displacement  Res. 

;  O  (99  Ship  Velocity  Response 
;  O  (99  Ship  Acceleration  Resp 
O  (99  Ship  Added  Resistance 
P  Motion  Point  Responses 
P  Relative  Motion  Point  Res. 

P  LONGCRESTED,  Height  =  7.5 
P  LONGCRESTED,  Height  =  7.5 
P  SHORTCRESTED,  Height  =  3. 

P  SHORTCRESTED,  Height  =  3. 

P  SHORTCRESTED,  Height  =  3.  ” 

i :  i  ► 


Plot  Type - 

r  Line 

C  Rectangular 
(*■  Polar 


-Style - 

(*  Fringe 
C  Contour 


-  Displacement 
C  Surge  Roll 
C  Sway  C  Pitch 
C  Heave  C  Yaw 


Speed  (kts)  |  12.0 

- J- 


splay  Controls 


Plot  Parameters  . . . 


Screen  Shot ...  | 


MODERNIZATION  PROGRAM 


Results  of  analyses  are  persisted  in 
LEAPS  DB  as  behavior  models 

—  Multi-dimensional  splines 

•  Example:  Drag  vs  Speed  vs  Draft 

IHDE  provides  multiple  ways  to  interact 
with  results 

—  2D  line  plots 

—  2D  fringe  plots 

—  2D  speed  polar  plots 

—  3D  wave  elevation  contours 

Slider  bars  effect  real-time  interrogation 
of  multi-dimensional  splines 

—  Dynamic  user  feedback 
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Example:  Improved  Process  for  Primary  Loads 
using  Large  Amplitude  Motions  Program  (LAMP) 


DOD 


MODERNIZATION  PROGRAM 


Previous  Process 


IHDE  Process 


LEAPS  DB 


Prob.  of  Exceedence(s) 


Execute  once:  all  sea  states,  speeds,  headings,  etc. 

Significant  time  savings 

•  Manual  preparation  time  reduced 

•  Less  chance  of  input  errors 

•  Parallel  execution  of  individual  runs 


Time  to  solution  reduced  from  Hours/Days  ->  minutes! 
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Other  User  Community  Barriers 


MODERNIZATION  PROGRAM 


•  Validation  of  Analysis  Tools 

—  It  is  important  for  users  to  understand  when  different  tools  are  applicable 

—  Need  to  verify  the  pedigree  of  any  geometry  or  data  being  used 

—  IHDE  Validation  Engine  in  V6  and  later  provides  a  means  for  users  to 
assess  the  accuracy  of  analysis  tool  predictions  through  comparisons  with 
experimental  model  test  data  and  best-practice  pre-computed  solutions 


•  One  of  the  major  challenges  is  getting  geometry  into 
LEAPS  Focus-compliant  format 

—  Previous  process  required  to  import  user-defined  geometry  was  very  labor 
intensive  and  represented  a  significant  barrier  to  new  users 

—  Morpheus  application  available  in  LEAPS  V5  provides  streamlined 
process  for  geometry  import 

•  Rhino  .3dm  or  .iges  formats 
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IHDE  Validation  Engine 

•  Validation  is  a  key  component  in  understanding  and 
demonstrating  the  applicability  of  different  tools  to 
different  types  of  problems 

—  IHDE  vision  is  to  provide  a  suite  of  different  analysis  tools  that  balance 
accuracy  with  computational  expense 

•  We  are  leveraging  a  wealth  of  experimental  model 
test  data  taken  over  decades  at  NSWC  Carderock 

—  Care  must  be  taken  to  establish  pedigree  of  geometry  and  data 

•  User  workflow  process  for  performing  comparisons 

—  Pre-computed  ship  resistance  analysis  vs.  included  model  test  data 

•  Does  not  require  any  new  predictions  on  the  part  of  the  user 

•  IHDEValidationDB  provided  with  IHDE  installation 

—  Wave  cuts  can  be  extracted  from  wave  elevation  behavior  objects  for 
comparison  with  model  test  data 
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IHDEValidationDB  Monohulls 


Model 

Description 

Ship  Scale 

Model  Scale 

Length  (ft) 

Beam  (ft) 

Length  (ft) 

Beam  (ft) 

5415 

Pre-contract  DDG  51 

465.9 

62.5 

18.77 

2.52 

5653 

JHSS  Baseline  Bulb  (BB) 

950.5 

104.9 

27.85 

3.08 

5653 

JHSS  Gooseneck  Bulb  (GB) 

950.5 

104.9 

28.71 

3.08 

5365 

R/V  Athena  1 

154.0 

22.6 

18.67 

2.74 

5653(BB) 


5653(GB) 

5365 
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IHDEValidationDB  Multi-hulls 


Model 

Description 

Ship  Scale 

Model  Scale 

Length 

Beam 

Length 

Beam 

372 

Delft  372  Catamaran 

--- 

--- 

9.84  ft 

3.08  ft 

5594 

HSS  (High  Speed  Sealift)  hull  concept 

1059  ft 

128.6  ft 

23.6  ft 

2.86  ft 

372 
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MODERNIZATION  PROGRAM 


Example:  Model  5365  (R/V  Athena) 


0.00700 


0.00560 


0.00420 


O 


0.00280 


0.00140 


0.000 


Draft  =  0.183  (m) 


0.100  0.300 


0.500  0.700 

Froude  Number 


a  Expt  (Fixed) 


0.900 


1.10 


Comparisons  with  experimental  data  both  fixed  and  free  to  sink  and  trim 
--  TSD  does  not  account  for  ship  motion 
--  TSD  under-predicts  resistance  at  higher  Fr 

--  Aegir  accounts  for  ship  motion  and  shows  much  improved  comparison  vs.  TSD 
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Example:  Delft  372  Catamaran 


MODERNIZATION  PROGRAM 


Top  View 


20.0  - 


o.oo  H - 1 - 1 - 1 - 1 

0.900  1.90  2.90  3.90  4.90 

Ship  Speed  (m/s) 


100. 


80.0 


CD 

o 

1 

.co 

co 

$ 

Oc 

2 
,o 


60.0 


40.0 


Draft  =  0.150  (m) 


•  Expt 
*TSD  Grid! 
*TSD  CapG3 

«  Aegir 


•  Comparison  of  different  grid  methods: 

—  “CapG3”  Capstone  mesh  shows  improved  accuracy  for  TSD 
predicted  resistance 

•  Comparison  of  different  analysis  tools 

—  Aegir  shows  improved  accuracy  vs.  TSD 
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LEAPS  Geometry  Pre-Processor 


MODERNIZATION  PROGRAM 


Morpheus  is  a  key  enabler  to 
lowering  the  entry  point  to  IHDE! 

—  Supports  .iges  and  Rhino  .3dm 

—  Drag-and-drop  hull  view 
associations 

—  Geometry  validation  compliancy 
checks  for  all  LEAPS  products 

—  Automatically  creates  LEAPS 
database  with  correct  geometry 
associations  and  attributions 

Morpheus  also  enables  simple 
hull  form  modifications  from 
parent  hull  form 


LEAPS  database  that  is  IHDE  compliant  can  be  generated  in  minutes! 
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Planned  IHDE  <§>  HPC  Portal 


MODERNIZATION  PROGRAM 


*  Web  portal  delivery  method 

—  No  local  installs 

—  Single  sign-on  for  authentication  using  CAC 

—  Provides  easy  access  to  larger  HPC  resources 

—  Future  enabler  for  design  engagement  of  CFD  methods 
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Summary 


MODERNIZATION  PROGRAM 


•  IHDE  is  a  desktop  application  that  integrates  a  suite  of  hull  form 
analysis  tools  including  visualization 

—  Ship  performance  areas:  Resistance,  Seakeeping,  Hydro  Loads,  Operability 

•  LEAPS  product  model: 

—  Provides  single  unified  representation  of  the  ship  model  and  maintains  the 
integrity  of  the  data  used  for  analysis 

—  Enables  Information  exchange  across  different  disciplines  in  a  timely  manner 

•  End-state  vision  of  IHDE  is  integrated  suite  of  design  and  analysis 
tools  to  fully  characterize  a  ship  design  with  appropriate  level  of 
definition 

—  Range  of  fidelity  =  accuracy  vs.  computational  expense 

—  Automated  meshing  and  analysis  preparation  &  parallel  execution 

—  Integrated  visualization 

—  Efficient  workflow  processes  and  data  exchange  at  all  levels  of  design 

•  IHDE  enables  direct  link  between  hydrodynamics  SMEs  and  ship 
design  agents  for  improved  ship  designs 
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Questions? 
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MODERNIZATION  PROGRAM 


Contact  Information: 


Wesley  M.  Wilson 

CREATE  Senior  Hydrodynamicist 

Computational  Design  &  Analysis  Branch  (Code  871) 

Naval  Surface  Warfare  Center  -  Carderock  Div. 

Phone:  (301)  227-5407 

email:  weslev.m.wilson@navv.mil 
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